llms.txt Index, edition 2026-11-04
In short
On 4 November 2026, 27.4 percent of 8,816 home pages that answered 200 in the crawl served a plain-text llms.txt, and 9.8 percent of those files were linked from the home page. Ora's lab found that 86 percent of agent fetches of the file came through a link.
What the edition measured
The crawl read 13,071 domains from the Tranco top 10,000 list (746WX) plus named vendors and Ora leaderboard sites, on 4 November 2026, with a plain-fetch client that honours robots.txt. 8,816 home pages answered 200. Of those, 2,418 serve a plain-text file at /llms.txt (27.4 percent). The other numbers are on the data page.
Adoption by category
Data & Analytics has the highest adoption of the categories shown, at 68.1 percent (98 of 144 home pages); Healthcare has the lowest, at 33.8 percent. The large remainder of the top 10,000 with no category is at 13.7 percent (761 of 5,573). The chart uses only categories with at least 8 home pages that answered 200, so small groups do not swing it.
Text equivalent of this chart
| Group | Value (%) | Counts |
|---|---|---|
| Payments & Fintech | 49.6 | 193 of 389 |
| Developer Tools | 58.9 | 216 of 367 |
| Healthcare | 33.8 | 81 of 240 |
| Infrastructure | 58.8 | 133 of 226 |
| Marketing | 55.4 | 118 of 213 |
| AI & ML | 49.2 | 95 of 193 |
| Data & Analytics | 68.1 | 98 of 144 |
| Productivity | 54.2 | 77 of 142 |
| E-commerce | 44.0 | 62 of 141 |
| Communication & Support | 54.3 | 76 of 140 |
| Agent Tools | 66.7 | 86 of 129 |
| Hardware & Robotics | 36.6 | 37 of 101 |
Adoption by platform
Platform comes from the generator meta tag on the home page, so it covers only the 1,332 home pages that answered 200 that declare one. A site that hides its generator is not counted here.
Text equivalent of this chart
| Group | Value (%) | Counts |
|---|---|---|
| WordPress | 26.0 | 107 of 411 |
| Framer | 41.9 | 80 of 191 |
| Drupal | 8.2 | 12 of 146 |
| Astro | 68.2 | 75 of 110 |
| HubSpot | 25.0 | 17 of 68 |
| Gatsby | 29.3 | 17 of 58 |
| Elementor | 36.7 | 11 of 30 |
| Wix | 93.1 | 27 of 29 |
| All | 48.1 | 13 of 27 |
| Hugo | 7.4 | 2 of 27 |
| TYPO3 | 10.5 | 2 of 19 |
| Craft CMS | 20.0 | 2 of 10 |
Linked versus unlinked
9.8 percent of the 2,418 files are linked from the home page HTML. Ora's lab found (2026-10-19) that 86 percent of the llms.txt fetches it traced arrived through a link, with 93 percent for .well-known files and 97 percent for openapi.json. The two numbers measure different things, one a site property and one an agent behaviour, and together they say the same thing: the file is useful when it is linked and rarely linked.
Text equivalent of this chart
| Group | Value (%) | Counts |
|---|---|---|
| Files linked from home | 9.8 | 237 of 2,418 |
| Files not linked | 90.2 | 2,181 of 2,418 |
| Agent fetches via link (Ora) | 86.0 | 356 of 416 attributed fetches |
Grades across all 2,529 files
| Grade | Files | Share |
|---|---|---|
| A | 1,584 | 62.6% |
| B | 525 | 20.8% |
| C | 277 | 11.0% |
| D | 127 | 5.0% |
| F | 16 | 0.6% |
Download and cite
llms-txt-index-2026-11-04.csv and llms-txt-index-2026-11-04.json hold one row per file: domain, rank, category, platform, size, H1, section count, link count, same-site links, whether the home page links it, whether llms-full.txt exists, grade and checks passed.
Cite this: Agent Ready HTML. The llms.txt Index, edition 2026-11-04. Edition 2026-11-04. https://agentreadyhtml.com/llms-txt-index/2026-11-04/
Back to the index.
Sources
- The crawl dataset (this site) https://agentreadyhtml.com/data/, read 4 November 2026
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026
- Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
Last reviewed 4 November 2026