agentreadyhtml.com llms.txt

llms.txt 69 KB, 344 lines

# Agent Ready HTML

> Paste a URL and see the initial HTML an agent receives, with the H1 and first 200 words marked, plus llms.txt, markdown, status codes and JSON-LD checks.

Agent Ready HTML shows what an agent receives when it fetches a page without running JavaScript, and what decides whether that view is readable. The Plain Fetch viewer at /viewer/ fetches any public URL with a plain client and flags the H1, the first 200 words, llms.txt, markdown on request, the status of a missing path, JSON-LD and OpenAPI links. The llms.txt Index at /llms-txt-index/ renders, parses and grades llms.txt files from a crawl of the Tranco top 10,000 against the llmstxt.org structure. Platforms (docs tools, site builders, frameworks, edge products) are scored on nine read-layer keys from dated documentation. Every fact carries a source URL and the date it was read. Vendor claims are labelled. The llms.txt Index rows, the crawl measures and the platform scores are also queryable through the MCP server at /mcp, the REST API described at /openapi.json and the NLWeb endpoint at /ask, all read-only and documented at /developers.

Every page has a markdown twin at the same path plus /index.md (or ask for it with Accept: text/markdown). The whole site in one file: https://agentreadyhtml.com/llms-full.txt. Sitemap: https://agentreadyhtml.com/sitemap.xml. Feed: https://agentreadyhtml.com/feed.xml.

## Home

- [Agent Ready HTML: what agents read when they fetch a page](https://agentreadyhtml.com/): Paste a URL and see the initial HTML an agent receives, with the H1 and first 200 words marked, plus llms.txt, markdown, status codes and JSON-LD checks.

## About

- [About: Agent Ready HTML](https://agentreadyhtml.com/about/): What Agent Ready HTML publishes, how it is made, and what each page carries: the viewer, the llms.txt Index, the platform rubric and the crawl dataset.
- [Contact: Agent Ready HTML](https://agentreadyhtml.com/contact/): How to reach the editor of Agent Ready HTML with a correction, a file to add to the index, or a question about the data.
- [Corrections: Agent Ready HTML](https://agentreadyhtml.com/corrections/): How to report an error on this site, what happens next, and where corrections are recorded with their dates. Sourced and dated, with a markdown twin for agents.
- [Editorial policy: Agent Ready HTML](https://agentreadyhtml.com/editorial-policy/): How facts are sourced and dated, how vendor claims are labelled, how scores are set and changed, and what the writing rules on this site are.
- [Method: viewer, index grading and rubric: Agent Ready HTML](https://agentreadyhtml.com/method/): How the Plain Fetch viewer reads a page, how an llms.txt is graded, how platforms are scored, how the crawl slice is cut, and where Ora fits on this layer.
- [Privacy: Agent Ready HTML](https://agentreadyhtml.com/privacy/): What this site collects when you read it or run the viewer: it sets no cookies, has no accounts and stores no page bodies; the host adds aggregate analytics.
- [Terms: Agent Ready HTML](https://agentreadyhtml.com/terms/): Terms of use for Agent Ready HTML: the content licence, the viewer's fair-use limits, the accuracy of the data and the links to other sites.

## Evidence

- [The cost of client-side rendering for agents: Agent Ready HTML](https://agentreadyhtml.com/client-side-rendering-and-agents/): What an agent loses when content only exists after JavaScript runs: Ora's lab result, 3.5% of crawled home pages as shells, and Ora's own pass rate.
- [JSON-LD types on home pages: Agent Ready HTML](https://agentreadyhtml.com/json-ld-types-on-home-pages/): 53.8% of 8,816 home pages carry JSON-LD. The most common types, the share by category, Ora's four JSON-LD checks and what the sources say about need.
- [llms.txt examples that score well on Ora: Agent Ready HTML](https://agentreadyhtml.com/llms-txt-examples/): 249 llms.txt files from the index joined to Ora's cached site scores: the 20 best examples and the median score at each structure grade, read 2026-11-05.
- [llms.txt size: how big the files in the crawl are: Agent Ready HTML](https://agentreadyhtml.com/llms-txt-size/): 2,529 llms.txt files by size and structure grade: the median is 7.6 KB, 5.3% are 100 KB or more. Crawl of 2026-11-04. Sourced and dated.
- [Markdown negotiation by platform: Agent Ready HTML](https://agentreadyhtml.com/markdown-negotiation-by-platform/): Which platforms answer Accept: text/markdown with markdown: crawl rates for 12 generators, rubric scores for 23 platforms and vendor statements.
- [Ora's Access layer, check by check: Agent Ready HTML](https://agentreadyhtml.com/ora-access-layer/): All 42 Access-layer checks in Ora's catalogue, with tier, points, spec and the pass rates Ora publishes, plus statuses for 248 index domains.
- [Soft 404s in the top 10,000, by platform: Agent Ready HTML](https://agentreadyhtml.com/soft-404s/): 16.9% of 8,743 made-up paths returned 200 in the crawl of 2026-11-04, with the rate by platform and category and each platform's default.
- [llms.txt files that no page links to: Agent Ready HTML](https://agentreadyhtml.com/unlinked-llms-txt/): 9.8% of 2,418 llms.txt files are linked from the home page. The rate by category and platform, and thirty ranked sites with the file and no link.

First 32 of 344 lines.