Guides
In short
Eleven guides cover what decides whether an agent can read a page: seeing the page as a plain-fetch client, checking the initial HTML the way an agent does, returning real status codes, writing llms.txt, serving markdown, JSON-LD, OpenAPI, sitemaps, getting docs cited and testing in CI. Each has sourced facts, steps and a check.
Crawl edition 2026-11-04, page updated 2026-11-04. How the viewer, the index and the scores work.
- How to see your site as a plain-fetch clientShow the reader the exact bytes an agent gets and how to judge them.6 sourced facts
- How to move the answer into the initial HTML without a rewriteGive the cheapest routes from a client-rendered page to HTML that carries the answer.6 sourced facts
- How to return real status codes on a single-page appMake missing pages return 404 and throttling return 429, even on client-routed apps.6 sourced facts
- How to write an llms.txt that gets followedShow the structure, the size limits and the linking that decide whether the file is used.6 sourced facts
- How to serve markdown on request on each hostPer-host recipes for Accept: text/markdown with the right headers.6 sourced facts
- How to add JSON-LD agents useWhich types to add, where, and why facts still belong in visible text.5 sourced facts
- How to expose OpenAPI for docsMake the API contract findable by link from the docs agents already read.6 sourced facts
- Why sitemaps are rarely fetched by agents and still matterSeparate what agents fetch from what search systems need.5 sourced facts
- How docs sites get citedWhat the data says about docs as the grounding source.6 sourced facts
- How to test readability in CITurn the checks into a build step that fails.6 sourced facts
- Check your initial HTML like an agent doesFetch the pages an agent opens first with JavaScript off, measure what arrives, and confirm bot protection lets agent user agents in.6 sourced facts
Every guide lists its sourced facts, then the steps, then how to check the result in the viewer.
Sources
- Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
Last reviewed 4 November 2026