Mintlify scopes llms.txt indexes per URL segment
In short
Mintlify began serving grouped llms.txt indexes per URL segment at /_llms/<segment>.md, so an agent can fetch one section of a docs site rather than the full index. Markdown served at a .md URL carries X-Robots-Tag: noindex, while markdown served on the normal URL through the Accept header does not.
Dated 21 August 2026. Source type: primary source. Read the source, read 4 November 2026.
What it changes for a reader
- The llms.txt reference covers the proposal, the versions and the evidence on whether agents use the file. Open it.
On this site
Sources
- Mintlify changelog https://www.mintlify.com/docs/changelog, read 4 November 2026
Last reviewed 4 November 2026