Hosts, CDNs and edge products in the vendors section
In short
12 hosts, CDNs and edge products are profiled, among them Cloudflare, Vercel, Netlify, Fastly and Akamai. A real 404 for a missing path is marked supports on 3 and partial on 4, and markdown on an Accept header is marked supports or partial on 4. Each profile lists its plans and its limits.
Crawl edition 2026-11-04, page updated 2026-11-05. How the viewer, the index and the scores work.
A host, CDN or edge product here is a service that routes, caches or rewrites what an agent receives. 2 of the 12 price a product by quote, and 5 bill by usage. For a made-up path the plain fetch got a 404 from 7 of the 11 own sites it could request, and another first answer, such as a redirect, a 200 or a refusal, from the rest.
The six standards across hosts, CDNs and edge products
| Standard | Supports | Partial | No statement |
|---|---|---|---|
| llms-txt generates or serves /llms.txt | 0 | 2 | 10 |
| markdown-negotiation answers Accept: text/markdown on the same URL | 0 | 4 | 8 |
| markdown-twin publishes a .md copy of each page | 0 | 2 | 10 |
| initial-html puts the page content in the server HTML by default | 2 | 7 | 3 |
| real-404 answers a missing path with a 404 status | 3 | 4 | 5 |
| vary-accept sends Vary: Accept when it negotiates | 2 | 1 | 9 |
Hosts, CDNs and edge products
| Vendor | What it does for this layer | Standards stated | Pricing model | Readings of its own site | Last read |
|---|---|---|---|---|---|
| Adobe Brand Visibility (formerly LLM Optimizer) | Adobe product whose Optimize at Edge feature routes AI agent traffic at the CDN to pre-rendered or rewritten HTML, so JavaScript-heavy pages and added summaries reach agents without changes in the CMS. | 1 supported: initial-html | No price read | Cloudflare scan not available Ora score not cached | 2026-11-05 |
| Akamai | CDN and edge platform. Akamai edge servers do not cache responses that carry a Vary header other than Accept-Encoding, which matters for any site that negotiates markdown, and EdgeWorkers can run JavaScript on requests and responses. | None stated as supported 1 partial: vary-accept | enterprise quote | Cloudflare scan not available Ora score 27, 2026-10-23 | 2026-11-05 |
| AWS Amplify Hosting | Git-connected hosting on AWS for static sites, single-page apps and server-rendered Next.js apps; its redirect rules decide whether a missing path answers 404 or hands every URL to a client-side router. | None stated as supported 2 partial: initial-html, real-404 | usage-based | Cloudflare scan 20, 2026-11-05 Ora score 60, 2026-10-30 | 2026-11-05 |
| Azure Static Web Apps | Microsoft's hosting for static front ends with managed Azure Functions APIs; a navigationFallback setting serves index.html for unmatched paths, and responseOverrides set what a 404 returns. | None stated as supported 1 partial: real-404 | freemium | Cloudflare scan 20, 2026-11-05 Ora score 51, 2026-05-11 | 2026-11-05 |
| Cloudflare | Edge network and host (Pages, Workers static assets) that can convert pages to markdown for agents on paid plans, sells Browser Run endpoints that render any URL to markdown or crawl a site, and lets owners allow or block AI crawlers per bot. | 1 supported: vary-accept 3 partial: markdown-negotiation, initial-html, real-404 | freemium, usage-based, free | Cloudflare scan 60, 2026-11-05 Ora score 82, 2026-11-05 | 2026-11-05 |
| Fastly | Edge cloud and CDN with Fastly Compute, a WebAssembly runtime where a small service can answer Accept: text/markdown or known AI crawlers with a cached markdown copy of the origin page. | None stated as supported 2 partial: markdown-negotiation, markdown-twin | usage-based | Cloudflare scan 20, 2026-11-05 Ora score 70, 2026-10-16 | 2026-11-05 |
| Firebase Hosting | Google's static and single-page app hosting on a global CDN, with a fixed response order that ends in a custom 404.html, plus Firebase App Hosting for server-rendered Next.js and Angular apps. | 1 supported: real-404 1 partial: initial-html | freemium, usage-based | Cloudflare scan 27, 2026-11-05 Ora score 56, 2026-10-21 | 2026-11-05 |
| GitHub Pages | Static hosting from a GitHub repository with an optional Jekyll build; a 404.html or 404.md in the repository becomes the custom not-found page, and server headers cannot be set. | 1 supported: real-404 1 partial: initial-html | free | Cloudflare scan 7, 2026-11-05 Ora score not cached | 2026-11-05 |
| Netlify | Web hosting and edge platform. Netlify answers missing paths with a site 404.html when one exists, offers a Prerender extension that hands JavaScript apps to agents as HTML, and publishes an edge-function template for markdown negotiation. | 1 supported: real-404 2 partial: markdown-negotiation, initial-html | freemium | Cloudflare scan 67, 2026-11-05 Ora score 90, 2026-11-04 | 2026-11-05 |
| Prerender.io | Dynamic rendering service that renders JavaScript pages in a headless browser, caches the HTML and serves it to search crawlers and AI crawlers, with meta tags that set the status code the cached copy returns. | 1 supported: initial-html 1 partial: real-404 | subscription | Cloudflare scan 33, 2026-11-05 Ora score not cached | 2026-11-05 |
| Scrunch | AI search visibility platform owned by Sitecore since June 2026. Its AXP product sits at the CDN and serves AI agents a simplified, JavaScript-free HTML copy of existing pages while people get the normal site; AXP is sold only on Enterprise contracts. | None stated as supported 2 partial: llms-txt, initial-html | subscription, enterprise quote | Cloudflare scan 20, 2026-11-05 Ora score 55, 2026-09-16 | 2026-11-05 |
| Vercel | Cloud host and CDN behind Next.js. Its own docs answer Accept: text/markdown and .md URLs with Vary: Accept, and its firewall has a free AI Bots ruleset that can block training crawlers while letting assistant fetches through. | 1 supported: vary-accept 4 partial: llms-txt, markdown-negotiation, markdown-twin, initial-html | freemium, free, usage-based | Cloudflare scan 60, 2026-11-05 Ora score 91, 2026-11-05 | 2026-11-05 |
The other types: docs platforms, frameworks, content management systems, site builders, tools for markdown and llms.txt. Back to all vendors.
Sources
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 5 November 2026
- Cloudflare: isitagentready.com https://isitagentready.com/, read 5 November 2026
Last reviewed 5 November 2026