How big is an llms.txt? Size and structure of the files in the crawl
In short
The median llms.txt in the crawl is 7.6 KB with 35 links, and 5.3 percent of 2,529 files are 100 KB or larger. Ora's catalogue recommends under 30,000 characters and says agents truncate past 100,000. The page charts size and structure grade and crosses the two.
The proposal says little about size. It asks for an H1, an optional summary and lists of links, and leaves the length to the author. The crawl found 2,529 plain-text llms.txt files on 4 November 2026, so the real distribution can be read off. The median file is 7.6 KB, with 35 links in 7 sections.
How large the files are
Text equivalent of this chart
| Size | Value | Counts |
|---|---|---|
| Under 2 KB | 222 | 8.8% |
| 2 to 10 KB | 1,282 | 50.7% |
| 10 to 50 KB | 799 | 31.6% |
| 50 to 100 KB | 94 | 3.7% |
| 100 KB and over | 133 | 5.3% |
133 files (5.3 percent) are 100 KB or larger, and 369 (14.6 percent) are larger than 30,000 bytes. Ora's catalogue recommends keeping the file under 30,000 characters and says agents truncate it past 100,000 characters, so nothing after that point is read (Ora's llms.txt formatting check, 5 November 2026). This site's own grade has a size check at 100 KB for the same reason.
Structure grades
Text equivalent of this chart
| Grade | Value | Counts |
|---|---|---|
| Grade A | 1,584 | 62.6% |
| Grade B | 525 | 20.8% |
| Grade C | 277 | 11.0% |
| Grade D | 127 | 5.0% |
| Grade F | 16 | 0.6% |
Size against grade
The grade is six structure checks, one of them the 100 KB limit, so the largest bucket cannot reach A. The table counts files by size bucket and grade.
| Size | A | B | C | D | F | Files |
|---|---|---|---|---|---|---|
| Under 2 KB | 124 | 41 | 27 | 30 | 0 | 222 |
| 2 to 10 KB | 818 | 239 | 155 | 64 | 5 | 1281 |
| 10 to 50 KB | 575 | 148 | 52 | 21 | 3 | 799 |
| 50 to 100 KB | 67 | 18 | 6 | 3 | 0 | 94 |
| 100 KB and over | 0 | 79 | 37 | 9 | 8 | 133 |
Median file
| Measure | Median |
|---|---|
| Size | 7.6 KB |
| Links | 35 |
| H2 sections | 7 |
| Links that stay on the same site | 28 |
247 files list no links at all. The guide to writing an llms.txt that gets followed sets the target for a new file, and the edition page has adoption by category and platform.
Cite this: Agent Ready HTML. llms.txt size and structure. Edition 2026-11-04. https://agentreadyhtml.com/llms-txt-size/
Sources
- The crawl dataset (this site) https://agentreadyhtml.com/data/, read 4 November 2026
- Ora check catalogue, contract 1.38.0 (llms.txt formatting) https://ora.ai/api/checks, read 5 November 2026
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026
Last reviewed 5 November 2026