---
title: "Why agents rarely fetch sitemaps: Agent Ready HTML"
description: "Separate what agents fetch from what search systems need. 5 sourced facts, 5 steps and a check you can run in the viewer."
canonical: https://agentreadyhtml.com/guides/sitemaps-rarely-fetched-still-matter/
site: "Agent Ready HTML"
last_updated: 2026-11-04
section: "Guides"
---

# Why agents rarely fetch sitemaps: Agent Ready HTML

> Separate what agents fetch from what search systems need. 5 sourced facts, 5 steps and a check you can run in the viewer.

Source: https://agentreadyhtml.com/guides/sitemaps-rarely-fetched-still-matter/
Site: Agent Ready HTML
Last reviewed: 2026-11-04

# Why sitemaps are rarely fetched by agents and still matter

In short

Agents fetched sitemap.xml directly in 4 percent of runs in the Vercel and Ora data, so a sitemap is not how an agent finds your answer. It still tells crawlers and search systems which pages are canonical. Keep it current, name it in robots.txt, and link the pages that matter from pages agents read.

Two readers use a site map for two different jobs. Search systems list pages from it. Agents mostly start at the home page or the docs and follow links.

## What the evidence says

-   Agents fetched sitemap.xml directly in 43 of 1,033 runs, 4 percent. \[primary source\] [source](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents), read 4 November 2026.
-   The guide says a sitemap main role is helping crawlers and search systems list canonical pages. \[primary source\] [source](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents), read 4 November 2026.
-   Agents reached docs in 83 percent of runs and fetched an average of 3.4 docs pages per docs-reaching run. \[primary source\] [source](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents), read 4 November 2026.
-   Framer generates sitemap.xml for every published site automatically. \[primary source\] [source](https://www.framer.com/help/articles/make-site-readable-by-ai-agents/), read 4 November 2026.
-   Vercel publishes a markdown sitemap so agents can discover markdown pages. \[primary source\] [source](https://vercel.com/blog/making-agent-friendly-pages-with-content-negotiation), read 4 November 2026.

## Steps

1.  Keep generating sitemap.xml with every canonical page and a real last-modified date.
2.  Name it in robots.txt with a Sitemap line.
3.  Do not rely on it for agents: link the pages that answer common questions from the home page, the docs index and llms.txt.
4.  If you serve markdown, consider a markdown sitemap so agents can discover the markdown pages, as Vercel does.
5.  Check that the sitemap lists only URLs that return 200 and carry a canonical tag pointing at themselves.

## Check the result

The sitemap is a search-system check. The viewer does not test it; the build of this site checks that every page in the sitemap is a built page. Open the [viewer](https://agentreadyhtml.com/viewer/) to run it on your own URL.

Related: [all guides](https://agentreadyhtml.com/guides/), [initial HTML](https://agentreadyhtml.com/initial-html/), [llms.txt](https://agentreadyhtml.com/llms-txt/).

## Sources

1.  [Vercel and Ora: Make your site readable by AI agents](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents) https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
2.  [Framer help: Make your site readable by AI agents](https://www.framer.com/help/articles/make-site-readable-by-ai-agents/) https://www.framer.com/help/articles/make-site-readable-by-ai-agents/, read 4 November 2026
3.  [Vercel: Making agent-friendly pages with content negotiation](https://vercel.com/blog/making-agent-friendly-pages-with-content-negotiation) https://vercel.com/blog/making-agent-friendly-pages-with-content-negotiation, read 4 November 2026

Last reviewed 4 November 2026

Edition

Crawl

2026-11-04

Page updated

2026-11-04

Method

How the viewer reads a page, how a file is graded and how a platform is scored: [the method page](https://agentreadyhtml.com/method/).

**Check it**  
Run the [viewer](https://agentreadyhtml.com/viewer/) after each step.