Agent Ready HTML

Hosts, CDNs and edge products in the vendors section

In short

12 hosts, CDNs and edge products are profiled, among them Cloudflare, Vercel, Netlify, Fastly and Akamai. A real 404 for a missing path is marked supports on 3 and partial on 4, and markdown on an Accept header is marked supports or partial on 4. Each profile lists its plans and its limits.

Crawl edition 2026-11-04, page updated 2026-11-05. How the viewer, the index and the scores work.

A host, CDN or edge product here is a service that routes, caches or rewrites what an agent receives. 2 of the 12 price a product by quote, and 5 bill by usage. For a made-up path the plain fetch got a 404 from 7 of the 11 own sites it could request, and another first answer, such as a redirect, a 200 or a refusal, from the rest.

The six standards across hosts, CDNs and edge products

12 hosts, CDNs and edge products by status, standard by standard.
StandardSupportsPartialNo statement
llms-txt
generates or serves /llms.txt
0210
markdown-negotiation
answers Accept: text/markdown on the same URL
048
markdown-twin
publishes a .md copy of each page
0210
initial-html
puts the page content in the server HTML by default
273
real-404
answers a missing path with a 404 status
345
vary-accept
sends Vary: Accept when it negotiates
219

Hosts, CDNs and edge products

Hosts, CDNs and edge products in alphabetical order, with what each does for the HTML an agent reads.
VendorWhat it does for this layerStandards statedPricing modelReadings of its own siteLast read
Adobe Brand Visibility (formerly LLM Optimizer)Adobe product whose Optimize at Edge feature routes AI agent traffic at the CDN to pre-rendered or rewritten HTML, so JavaScript-heavy pages and added summaries reach agents without changes in the CMS.1 supported: initial-htmlNo price readCloudflare scan not available
Ora score not cached
2026-11-05
AkamaiCDN and edge platform. Akamai edge servers do not cache responses that carry a Vary header other than Accept-Encoding, which matters for any site that negotiates markdown, and EdgeWorkers can run JavaScript on requests and responses.None stated as supported
1 partial: vary-accept
enterprise quoteCloudflare scan not available
Ora score 27, 2026-10-23
2026-11-05
AWS Amplify HostingGit-connected hosting on AWS for static sites, single-page apps and server-rendered Next.js apps; its redirect rules decide whether a missing path answers 404 or hands every URL to a client-side router.None stated as supported
2 partial: initial-html, real-404
usage-basedCloudflare scan 20, 2026-11-05
Ora score 60, 2026-10-30
2026-11-05
Azure Static Web AppsMicrosoft's hosting for static front ends with managed Azure Functions APIs; a navigationFallback setting serves index.html for unmatched paths, and responseOverrides set what a 404 returns.None stated as supported
1 partial: real-404
freemiumCloudflare scan 20, 2026-11-05
Ora score 51, 2026-05-11
2026-11-05
CloudflareEdge network and host (Pages, Workers static assets) that can convert pages to markdown for agents on paid plans, sells Browser Run endpoints that render any URL to markdown or crawl a site, and lets owners allow or block AI crawlers per bot.1 supported: vary-accept
3 partial: markdown-negotiation, initial-html, real-404
freemium, usage-based, freeCloudflare scan 60, 2026-11-05
Ora score 82, 2026-11-05
2026-11-05
FastlyEdge cloud and CDN with Fastly Compute, a WebAssembly runtime where a small service can answer Accept: text/markdown or known AI crawlers with a cached markdown copy of the origin page.None stated as supported
2 partial: markdown-negotiation, markdown-twin
usage-basedCloudflare scan 20, 2026-11-05
Ora score 70, 2026-10-16
2026-11-05
Firebase HostingGoogle's static and single-page app hosting on a global CDN, with a fixed response order that ends in a custom 404.html, plus Firebase App Hosting for server-rendered Next.js and Angular apps.1 supported: real-404
1 partial: initial-html
freemium, usage-basedCloudflare scan 27, 2026-11-05
Ora score 56, 2026-10-21
2026-11-05
GitHub PagesStatic hosting from a GitHub repository with an optional Jekyll build; a 404.html or 404.md in the repository becomes the custom not-found page, and server headers cannot be set.1 supported: real-404
1 partial: initial-html
freeCloudflare scan 7, 2026-11-05
Ora score not cached
2026-11-05
NetlifyWeb hosting and edge platform. Netlify answers missing paths with a site 404.html when one exists, offers a Prerender extension that hands JavaScript apps to agents as HTML, and publishes an edge-function template for markdown negotiation.1 supported: real-404
2 partial: markdown-negotiation, initial-html
freemiumCloudflare scan 67, 2026-11-05
Ora score 90, 2026-11-04
2026-11-05
Prerender.ioDynamic rendering service that renders JavaScript pages in a headless browser, caches the HTML and serves it to search crawlers and AI crawlers, with meta tags that set the status code the cached copy returns.1 supported: initial-html
1 partial: real-404
subscriptionCloudflare scan 33, 2026-11-05
Ora score not cached
2026-11-05
ScrunchAI search visibility platform owned by Sitecore since June 2026. Its AXP product sits at the CDN and serves AI agents a simplified, JavaScript-free HTML copy of existing pages while people get the normal site; AXP is sold only on Enterprise contracts.None stated as supported
2 partial: llms-txt, initial-html
subscription, enterprise quoteCloudflare scan 20, 2026-11-05
Ora score 55, 2026-09-16
2026-11-05
VercelCloud host and CDN behind Next.js. Its own docs answer Accept: text/markdown and .md URLs with Vary: Accept, and its firewall has a free AI Bots ruleset that can block training crawlers while letting assistant fetches through.1 supported: vary-accept
4 partial: llms-txt, markdown-negotiation, markdown-twin, initial-html
freemium, free, usage-basedCloudflare scan 60, 2026-11-05
Ora score 91, 2026-11-05
2026-11-05

The other types: docs platforms, frameworks, content management systems, site builders, tools for markdown and llms.txt. Back to all vendors.

Sources

  1. llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 5 November 2026
  2. Cloudflare: isitagentready.com https://isitagentready.com/, read 5 November 2026

Last reviewed 5 November 2026