Agent Ready HTML

Why sitemaps are rarely fetched by agents and still matter

In short

Agents fetched sitemap.xml directly in 4 percent of runs in the Vercel and Ora data, so a sitemap is not how an agent finds your answer. It still tells crawlers and search systems which pages are canonical. Keep it current, name it in robots.txt, and link the pages that matter from pages agents read.

Two readers use a site map for two different jobs. Search systems list pages from it. Agents mostly start at the home page or the docs and follow links.

What the evidence says

  • Agents fetched sitemap.xml directly in 43 of 1,033 runs, 4 percent. [primary source] source, read 4 November 2026.
  • The guide says a sitemap main role is helping crawlers and search systems list canonical pages. [primary source] source, read 4 November 2026.
  • Agents reached docs in 83 percent of runs and fetched an average of 3.4 docs pages per docs-reaching run. [primary source] source, read 4 November 2026.
  • Framer generates sitemap.xml for every published site automatically. [primary source] source, read 4 November 2026.
  • Vercel publishes a markdown sitemap so agents can discover markdown pages. [primary source] source, read 4 November 2026.

Steps

  1. Keep generating sitemap.xml with every canonical page and a real last-modified date.
  2. Name it in robots.txt with a Sitemap line.
  3. Do not rely on it for agents: link the pages that answer common questions from the home page, the docs index and llms.txt.
  4. If you serve markdown, consider a markdown sitemap so agents can discover the markdown pages, as Vercel does.
  5. Check that the sitemap lists only URLs that return 200 and carry a canonical tag pointing at themselves.

Check the result

The sitemap is a search-system check. The viewer does not test it; the build of this site checks that every page in the sitemap is a built page. Open the viewer to run it on your own URL.

Related: all guides, initial HTML, llms.txt.

Sources

  1. Vercel and Ora: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
  2. Framer help: Make your site readable by AI agents https://www.framer.com/help/articles/make-site-readable-by-ai-agents/, read 4 November 2026
  3. Vercel: Making agent-friendly pages with content negotiation https://vercel.com/blog/making-agent-friendly-pages-with-content-negotiation, read 4 November 2026

Last reviewed 4 November 2026