--- title: "News: llms.txt, markdown and agent readability: Agent Ready HTML" description: "17 dated items from the last 90 days on llms.txt, markdown for agents, docs platforms and scanners, each with its source and the date it was read." canonical: https://agentreadyhtml.com/news/ site: "Agent Ready HTML" last_updated: 2026-11-04 section: "News" --- # News: llms.txt, markdown and agent readability: Agent Ready HTML > 17 dated items from the last 90 days on llms.txt, markdown for agents, docs platforms and scanners, each with its source and the date it was read. Source: https://agentreadyhtml.com/news/ Site: Agent Ready HTML Last reviewed: 2026-11-04 # News In short 17 dated items from 2026-08-10 to 2026-11-05: the llms.txt version 2 revision, Mintlify and Fern changes, the Vercel and Ora readability guide, the AgentReady standard, a new llms.txt validator and Cloudflare's per-agent controls. Each item links its source and says whether it is a vendor claim. Crawl edition 2026-11-04, page updated 2026-11-04. [How the viewer, the index and the scores work](https://agentreadyhtml.com/method/). - [Ora's check catalogue lists 132 checks, 42 in the Access layer](https://agentreadyhtml.com/news/2026-11-05-ora-s-check-catalogue-lists-132-checks-42-in-the-access-laye/)Ora's public check catalogue, contract version 1.38.0, lists 132 checks in four layers: Discovery 16, Access 42, Usability 68 and Payments 6.2026-11-05 - [Ora's statistics: 145,929 sites scanned, average score 44](https://agentreadyhtml.com/news/2026-11-05-ora-s-statistics-145-929-sites-scanned-average-score-44/)Ora's statistics endpoint reports 145,929 sites scanned and 132,097 companies ranked on 5 November 2026, an average score of 44, and 9,233 ranked sites (7.0 percent) at grade B or better.2026-11-05 - [Cloudflare adds per-agent controls for personal agents](https://agentreadyhtml.com/news/2026-11-04-cloudflare-adds-per-agent-controls-for-personal-agents/)Cloudflare renamed Configure AI bot policies to AI Crawler and Agent access policies and added individual settings for the top personal agents that fetch pages on a person's behalf.2026-11-04 - [Weekly tracker: 58.8 percent of 219 notable hosts serve llms.txt](https://agentreadyhtml.com/news/2026-11-02-weekly-tracker-58-8-percent-of-219-notable-hosts-serve-llms/)The llmtxt.info tracker, which fetches 219 notable hosts weekly, reported on 2026-11-02 that 127 of them (58.8 percent) serve an llms.txt file.2026-11-02 - [Fern moves docs to static prebuilt pages](https://agentreadyhtml.com/news/2026-10-30-fern-moves-docs-to-static-prebuilt-pages/)Fern Docs sites are now prebuilt as static pages and served from the edge; custom domains still pointing to Vercel must move to cname.ferndocs.com by 2026-12-01 or publishing will fail.2026-10-30 - [Mintlify markdown export renders components as plain markdown](https://agentreadyhtml.com/news/2026-10-23-mintlify-markdown-export-renders-components-as-plain-markdow/)Mintlify .md pages now render components, Visibility content and snippets as plain markdown, and links to navigation pages point to their .md versions with the full site URL.2026-10-23 - [AgentReady standard launches with read-layer MUSTs](https://agentreadyhtml.com/news/2026-10-19-agentready-standard-launches-with-read-layer-musts/)AgentReady.org launched as an MIT-licensed standard maintained with Vercel, Mintlify, Elementor and others. Its read MUSTs are the answer in initial HTML and real status codes; linking llms.txt, JSON-LD and OpenAPI is a SHOULD.2026-10-19 - [LLMs Ledger launches an llms.txt validator](https://agentreadyhtml.com/news/2026-10-15-llms-ledger-launches-an-llms-txt-validator/)LLMs Ledger announced a free llms.txt validator, generator and public directory with monitoring for broken or changed files, and described the format as still a proposal.2026-10-15 - [Ora paper "AX is the new AEO"](https://agentreadyhtml.com/news/2026-10-08-ora-paper-ax-is-the-new-aeo/)Ora published "AX is the new AEO" with 37,927 journeys and 140,000+ page fetches; it reports not-ready sites take 23 percent more turns and that agent-ready sites supply 78 percent of the finished answer against 58 percent.2026-10-08 - [Server logs: answer assistants ignored markdown twins](https://agentreadyhtml.com/news/2026-09-22-server-logs-answer-assistants-ignored-markdown-twins/)GoodBarber reported two weeks of logs (4 to 18 September): training crawlers took about 80,000 markdown requests and coding agents about 22,000 negotiated ones, while ChatGPT, Claude on the web and Perplexity answering people fetched HTML over 13,000 times and markdown once.2026-09-22 - [Fern adds llms.txt filters and wider agent 404s](https://agentreadyhtml.com/news/2026-09-18-fern-adds-llms-txt-filters-and-wider-agent-404s/)Fern added lang=php and excludeChangelog=true to llms.txt and per-page markdown URLs, and raised the similar-page suggestions in agent 404 responses from three to five.2026-09-18 - [Vercel and Ora publish the readability guide](https://agentreadyhtml.com/news/2026-08-28-vercel-and-ora-publish-the-readability-guide/)Vercel published "Make your site readable by AI agents" with Ora, citing 1,033 agent runs across 25 sites and 190 fetch probes: agents reached llms.txt through links in 86 percent of attributed fetches and requested markdown on 65.1 percent of fetches.2026-08-28 - [Mintlify root llms.txt links per-section indexes](https://agentreadyhtml.com/news/2026-08-28-mintlify-root-llms-txt-links-per-section-indexes/)Mintlify changed the root llms.txt to link the per-section indexes under /\_llms and scoped language-specific llms.txt routes to their language.2026-08-28 - [Vercel launches is-agentic.com scanner with Ora scans](https://agentreadyhtml.com/news/2026-08-23-vercel-launches-is-agentic-com-scanner-with-ora-scans/)MarkTechPost reported Vercel launched Is Agentic, a free agent-readiness score whose scans are run by Ora, with Essential, Recommended and Bonus tiers, a CLI and an MCP endpoint.2026-08-23 - [Mintlify scopes llms.txt indexes per URL segment](https://agentreadyhtml.com/news/2026-08-21-mintlify-scopes-llms-txt-indexes-per-url-segment/)Mintlify began serving grouped llms.txt indexes per URL segment at /\_llms/.md, so an agent can fetch one section of a docs site rather than the full index.2026-08-21 - [Search press: v2 leaves Google guidance unchanged](https://agentreadyhtml.com/news/2026-08-17-search-press-v2-leaves-google-guidance-unchanged/)Search Engine Journal reported that v2 is the first revision of llms.txt and that the Google Search team still says it does not use the file, while the Chrome Lighthouse team audits it in the Agentic Browsing category.2026-08-17 - [llms.txt proposal revised to version 2](https://agentreadyhtml.com/news/2026-08-10-llms-txt-proposal-revised-to-version-2/)The llmstxt.org page was updated to v2 on 2026-08-10. v2 adds rel="alternate" type="text/markdown" and rel="describedby" link relations, allows page.md as well as page.html.md, defines how subpath llms.txt files apply, and drops the llms\_txt2ctx tooling and the mechanical meaning of the Optional section.2026-08-10 ## Sources 1. [llms.txt v1 to v2 changes](https://llmstxt.org/changes.html) https://llmstxt.org/changes.html, read 4 November 2026 Last reviewed 4 November 2026