--- title: "Mintlify scopes llms.txt indexes per URL segment: Agent Ready HTML" description: "Mintlify scopes llms.txt indexes per URL segment, dated 2026-08-21, with its source and the kind of source it is. Read 2026-11-04." canonical: https://agentreadyhtml.com/news/2026-08-21-mintlify-scopes-llms-txt-indexes-per-url-segment/ site: "Agent Ready HTML" last_updated: 2026-11-04 date: 2026-08-21 section: "News" --- # Mintlify scopes llms.txt indexes per URL segment: Agent Ready HTML > Mintlify scopes llms.txt indexes per URL segment, dated 2026-08-21, with its source and the kind of source it is. Read 2026-11-04. Source: https://agentreadyhtml.com/news/2026-08-21-mintlify-scopes-llms-txt-indexes-per-url-segment/ Site: Agent Ready HTML Last reviewed: 2026-11-04 # Mintlify scopes llms.txt indexes per URL segment In short Mintlify began serving grouped llms.txt indexes per URL segment at /\_llms/.md, so an agent can fetch one section of a docs site rather than the full index. Markdown served at a .md URL carries X-Robots-Tag: noindex, while markdown served on the normal URL through the Accept header does not. Published 21 August 2026 Dated 21 August 2026. Source type: primary source. [Read the source](https://www.mintlify.com/docs/changelog), read 4 November 2026. ## What it changes for a reader - The llms.txt reference covers the proposal, the versions and the evidence on whether agents use the file. [Open it](https://agentreadyhtml.com/llms-txt/). ## On this site - [Mintlify profile](https://agentreadyhtml.com/platforms/mintlify/) - [All news](https://agentreadyhtml.com/news/) - [Run the viewer on your own page](https://agentreadyhtml.com/viewer/) ## Sources 1. [Mintlify changelog](https://www.mintlify.com/docs/changelog) https://www.mintlify.com/docs/changelog, read 4 November 2026 Last reviewed 4 November 2026 Edition Crawl 2026-11-04 Page updated 2026-11-04 Method How the viewer reads a page, how a file is graded and how a platform is scored: [the method page](https://agentreadyhtml.com/method/).