Agent Ready HTML

The Plain Fetch viewer

In short

The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.

Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.

GET https://developers.cloudflare.com/ answered 200 with text/html, 199 KB, read 8 November 2026, 13:23 UTC.

Permalink: /viewer/?url=https://developers.cloudflare.com/

The page answers a plain fetch: 6 of 6 checks found.

Initial HTML what a plain fetch receives

<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
[... 3 more head elements folded ...]
<title>Cloudflare Developer Docs | Cloudflare Docs
</title>
<meta name="generator" content="Astro v7.4.5">
<meta name="generator" content="Nimbus v0.2.2">
<meta name="description" content="Connect, protect, and build everywhere.">
[... 3 more head elements folded ...]
<link rel="canonical" href="https://developers.cloudflare.com/">
<link rel="sitemap" href="/sitemap-index.xml">
<link rel="alternate" type="text/markdown" href="https://developers.cloudflare.com/index.md">
[... 17 more head elements folded ...]
</head>
<body class="bg-background text-foreground min-h-screen"><a href="#main-content" class="focus:bg-primary focus:text-primary-foreground focus-visible:outline-ring sr-only focus:not-sr-only focus:absolute focus:top-2 focus:left-2 focus:z-100 focus:rounded-md focus:px-4 focus:py- [... 109 characters folded ...]>Skip to content</a>
<div class="flex h-full flex-col">
<header class="border-border sticky top-0 z-30 border-b">
<div aria-hidden="true" class="bg-card/80 pointer-events-none absolute inset-0 backdrop-blur-lg">
</div>
<div class="relative mx-auto flex h-14 items-center justify-between px-4 lg:px-6">
<div class="flex items-center gap-3"><a href="/" aria-label="Cloudflare Docs" class="group flex items-center gap-2 lg:w-[calc(var(--nb-sidebar-width)-3.25rem-1px)] lg:shrink-0"><img src="/_astro/logo.te5VL_aD.svg" alt="" width="51" height="23" class="h-[20px] w-auto">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 719 59" fill="none" role="img" aria-label="Cloudflare" class="text-foreground group-hover:text-primary hidden h-[11px] w-auto transition-colors sm:block">[... 2,385 characters folded ...]
</svg><span class="text-foreground/70 border-border-strong hidden rounded-md border px-1.5 py-0.5 text-[11px] leading-none font-semibold tracking-[0.08em] uppercase sm:inline-block">Docs</span></a>
<nav aria-label="Sections" class="border-border ml-4 hidden h-6 items-center gap-1 border-l pl-4 md:flex"><a href="/directory/" class="rounded-md px-2 py-1 text-[0.8125rem] font-medium no-underline transition-colors text-muted-foreground hover:text-foreground hover:bg-accent/60">Directory</a><a href="/api/" class="rounded-md px-2 py-1 text-[0.8125rem] font-medium no-underline transition-colors text-muted-foreground hover:text-foreground hover:bg-accent/60">API</a><a href="/fundamentals/api/reference/sdks/" class="rounded-md px-2 py-1 text-[0.8125rem] font-medium no-underline transition-colors text-muted-foreground hover:text-foreground hover:bg-accent/60">SDKs</a><a href="/changelog/" class="rounded-md px-2 py-1 text-[0.8125rem] font-medium no-underline transition-colors text-muted-foreground hover:text-foreground hover:bg-accent/60">Changelog</a>
</nav>
</div>
<div class="flex items-center gap-2" data-header-actions>
<script>[... 311 characters folded ...]
</script><cfdocs-search id="search" data-astro-transition-persist="search"><button type="button" class="search-button" aria-label="Search" data-search-trigger>
<svg width="20" height="20" class="search-icon" viewBox="0 0 20 20" aria-hidden="true">[... 315 characters folded ...]
</svg><span class="search-placeholder">Search</span><span class="search-keys"><kbd class="search-key" data-search-shortcut-modifier>Ctrl</kbd><kbd class="search-key">K</kbd></span></button><search-modal-snippet api-url="https://ai-search.developers.cloudflare.com/api/ai-search" placeholder="Search documentation..." max-results="50" max-render-results="10" group-by="product" hide-thumbnails="true" show-url="false"></search-modal-snippet></cfdocs-search>
<script type="module" src="/_astro/Search.astro_astro_type_script_index_0_lang.DH3uW6MT.js">
</script><a href="https://github.com/cloudflare/cloudflare-docs" data-nb-button class="group shrink-0 items-center justify-center font-medium whitespace-nowrap no-underline transition-colors cursor-pointer select-none focus-visib [... 273 characters folded ...]>
<svg width="1em" height="1em" viewBox="0 0 256 256" class="h-4 w-4" data-icon="ph:github-logo">[... 813 characters folded ...]
</svg></a><button data-nb-theme-toggle class="group flex items-center justify-center w-8 h-8 rounded-md text-muted-foreground hover:text-foreground hover:bg-accent transition-colors" aria-label="Toggle theme (light, dark, system)">
<svg width="1em" height="1em" viewBox="0 0 256 256" class="nb-theme-ico nb-theme-ico-light h-[1.125rem] w-[1.125rem]" data-icon="ph:sun">[... 599 characters folded ...]
</svg>
<svg width="1em" height="1em" viewBox="0 0 256 256" class="nb-theme-ico nb-theme-ico-dark h-[1.125rem] w-[1.125rem]" data-icon="ph:moon">[... 389 characters folded ...]
</svg>
<svg width="1em" height="1em" viewBox="0 0 256 256" class="nb-theme-ico nb-theme-ico-auto h-[1.125rem] w-[1.125rem]" data-icon="ph:monitor">[... 254 characters folded ...]
</svg></button>
<script type="module" src="/_astro/ThemeToggle.astro_astro_type_script_index_0_lang.CF3gVrsF.js">
</script>
<div class="bg-border mx-1.5 hidden h-4 w-px shrink-0 md:block" role="separator">
</div><a href="https://dash.cloudflare.com/" data-nb-button class="group w-max shrink-0 items-center justify-center rounded-full font-medium whitespace-nowrap no-underline shadow-xs transition-colors cursor-pointer select-none [... 262 characters folded ...]><span data-auth="logged-out">Log in</span><span data-auth="logged-in">Dashboard</span></a><button type="button" data-nb-button class="group inline-flex shrink-0 items-center justify-center font-medium whitespace-nowrap no-underline transition-colors cursor-pointer select-none focus-visible:outline-2 focus-vis [... 245 characters folded ...]>
<svg width="1em" height="1em" viewBox="0 0 256 256" class="h-4 w-4" data-icon="ph:list">[... 178 characters folded ...]
</svg></button>
</div>
</div>
</header>
<div class="bg-background text-foreground flex w-full flex-col overflow-x-clip">
<div class="flex">
<div class="border-border hidden w-(--nb-sidebar-width) shrink-0 border-r lg:block">
<aside data-nb-desktop-sidebar class="sticky top-14 flex h-[calc(100vh-3.5rem)] flex-col overflow-y-auto">
<nav class="flex-1 px-4 pt-5 pb-12" aria-label="Documentation">
<div class="relative mb-5"><input data-nb-sidebar-filter-input type="search" placeholder="Filter sidebar" class="peer border-border bg-card text-foreground placeholder:text-muted-foreground focus-visible:border-brand focus-visible:outline-ring w-f [... 177 characters folded ...]><kbd aria-hidden="true" class="border-border bg-muted text-muted-foreground pointer-events-none absolute top-1/2 right-2 flex h-5 min-w-5 -translate-y-1/2 items-center justify-center rounded border px-1 font-mono text-[0 [... 163 characters folded ...]>/</kbd>
</div>
<div data-nb-sidebar class="flex flex-col gap-0.5">
<div data-nb-sidebar-group>
<p data-nb-sidebar-group-label class="text-foreground mb-1 px-3 text-[0.6875rem] font-medium tracking-[0.05em] uppercase opacity-45">Get started
</p>
<ul class="flex list-none flex-col gap-0.5 p-0">
<li><a href="/" aria-current="page" data-nb-sidebar-link><span class="break-words">Overview</span></a>
</li>
<li><a href="/api/" data-nb-sidebar-link><span class="break-words">API</span></a>
</li>
<li><a href="/agent-setup/" data-nb-sidebar-link><span class="break-words">Agent Setup</span></a>
</li>
<li><a href="/directory/" data-nb-sidebar-link><span class="break-words">Directory</span></a>
</li>
<li><a href="/changelog/" data-nb-sidebar-link><span class="break-words">Changelog</span></a>
</li>
<li>
<div data-nb-collapsible class data-nb-sidebar-group="true"><button type="button" data-nb-collapsible-trigger class data-nb-sidebar-group-label="true" data-nb-state="closed" aria-expanded="false"><span data-nb-sidebar-group-text><span class="break-words">Resources</span></span><span data-nb-caret aria-hidden="true"></span></button>
<div data-nb-collapsible-content class data-nb-state="closed">
<div>
<ul data-nb-sidebar-sublist>
<li><a href="/resources/?filter-pcx_content_type=learning-path" data-nb-sidebar-link><span class="break-words">Learning paths</span></a>
</li>
<li><a href="/use-cases/" data-nb-sidebar-link><span class="break-words">Use cases</span></a>
</li>
<li><a href="/reference-architecture/" data-nb-sidebar-link><span class="break-words">Reference architecture</span></a>
</li>
</ul>
</div>
</div>
</div>
<script type="module" src="/_astro/Collapsible.astro_astro_type_script_index_0_lang.Ctvl-5qS.js">
</script>
</li>
<li>
<div data-nb-collapsible class data-nb-sidebar-group="true"><button type="button" data-nb-collapsible-trigger class data-nb-sidebar-group-label="true" data-nb-state="closed" aria-expanded="false"><span data-nb-sidebar-group-text><span class="break-words">API &amp; IaC</span></span><span data-nb-caret aria-hidden="true"></span></button>
<div data-nb-collapsible-content class data-nb-state="closed">
<div>
<ul data-nb-sidebar-sublist>
<li><a href="/api/" data-nb-sidebar-link><span class="break-words">API reference</span></a>
</li>
<li><a href="/terraform/" data-nb-sidebar-link><span class="break-words">Terraform</span></a>
</li>
<li><a href="/pulumi/" data-nb-sidebar-link><span class="break-words">Pulumi</span></a>
</li>
<li><a href="/fundamentals/api/reference/sdks/" data-nb-sidebar-link><span class="break-words">SDKs</span></a>
</li>
</ul>
</div>
</div>
</div>
</li>
<li><a href="/support/" data-nb-sidebar-link><span class="break-words">Support</span></a>
</li>
</ul>
</div>
<div data-nb-sidebar-group class="mt-3">
<p data-nb-sidebar-group-label class="text-foreground mb-1 px-3 text-[0.6875rem] font-medium tracking-[0.05em] uppercase opacity-45">Developer Tools
</p>
<ul class="flex list-none flex-col gap-0.5 p-0">
<li><a href="/cf/" data-nb-sidebar-link>
<svg width="1em" height="1em" viewBox="0 0 48 48" class="h-4 w-4 shrink-0" aria-hidden="true" data-icon="cf"><path fill="currentColor" d="m8.94 12.06 2.12-2.12L25.12 24 11.06 38.06l-2.12-2.12L20.88 24zM27 35h13v3H27z"/>
</svg><span class="break-words">Cloudflare CLI</span></a>
</li>
</ul>
</div>
<div data-nb-sidebar-group class="mt-3">
<p data-nb-sidebar-group-label class="text-foreground mb-1 px-3 text-[0.6875rem] font-medium tracking-[0.05em] uppercase opacity-45">Build
</p>
<ul class="flex list-none flex-col gap-0.5 p-0">
<li>
<div data-nb-collapsible class data-nb-sidebar-group="true"><button type="button" data-nb-collapsible-trigger class data-nb-sidebar-group-label="true" data-nb-state="closed" aria-expanded="false"><span data-nb-sidebar-group-text>
<svg width="0.98em" height="1em" viewBox="0 0 48 49" class="text-muted-foreground h-4 w-4 shrink-0" data-icon="workers">[... 321 characters folded ...]
</svg><span class="break-words">Compute</span></span><span data-nb-caret aria-hidden="true"></span></button>
<div data-nb-collapsible-content class data-nb-state="closed">
<div>
<ul data-nb-sidebar-sublist>
<li><a href="/workers/" data-nb-sidebar-link><span class="break-words">Workers</span></a>
</li>
<li><a href="/containers/" data-nb-sidebar-link><span class="break-words">Containers</span></a>
</li>

Shown with 145 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; line breaks added before block tags because the source is minified; the pane stops after the first 200 words; the page is 199 KB.

Reading view the text a plain-fetch client can extract

title: Cloudflare Developer Docs | Cloudflare Docs

Cloudflare Developer Docs

Skip to content Docs Directory API SDKs Changelog SearchCtrlK Log inDashboard / Get started Overview API Agent Setup Directory Changelog Resources Learning paths Use cases Reference architecture API & IaC API reference Terraform Pulumi SDKs Support Developer Tools Cloudflare CLI Build Compute Workers Containers Durable Objects Queues Workflows Flagship Browser Run Workers VPC Cloudflare for Platforms Email Service AI Models Workers AI AI Gateway Agents Agent Memory Wallets Sandboxes Vectorize AI Search Web Search API AI Crawl Control Storage & Database R2 Basin Overview Basin Pipelines Basin Catalog Basin SQL K2 D1 KV Hyperdrive Artifacts Media Images Stream Realtime Protect & Connect Application Security WAF DDoS Protection SSL/TLS Bots API Shield Page Shield Turnstile Security Center Cloudflare One Overview Insights & Logs Team & Resources Networks Access controls Traffic controls Cloud & SaaS findings Email security Cloud Workload SecurityBeta Data loss prevention Browser isolation Reusable components Integrations Domains & DNS DNS 1.1.1.1 Registrar Email Routing DMARC Management Networking Tunnel Mesh Magic Transit Magic WAN Network Interconnect Spectrum BYOIP Monetize Monetization Gateway Delivery & Performance Cache Speed Load Balancing Waiting Room Argo Smart Routing Zaraz Manage & Observe Observe Observability Analytics Web Analytics Logs Log Explorer Health Checks Cloudflare Developer Docs

1182 more words follow in the initial HTML.

6 found, 0 missing, 1 note, from 7 checks run

  • H1Found
  • 200 wordsFound
  • llms.txtFound
  • MarkdownFound
  • Missing pathFound
  • JSON-LDFound
  • OpenAPINote
What a plain fetch found on developers.cloudflare.com
CheckResultDetail
H1 in the initial HTMLFound one H1First H1: Cloudflare Developer Docs
First 200 words in the initial HTMLFound 200 of 200 wordsThe initial HTML carries 1382 words of visible text; the first 200 are marked in the left pane.
llms.txt present and linkedFound present and linked16787 bytes, 112 links. Structure grade A (6 of 6). The home page links it, which is how agents reached it in Ora's lab.
Markdown on requestFound text/markdownAccept: text/markdown returned 200 with text/markdown; charset=utf-8. Vary: Accept is set.
Status of a made-up pathFound 404/agent-ready-html-missing-path-check returned 404: a real status code for a missing page.
JSON-LD typesFound ContactPoint, ImageObject, Organization, PostalAddress and 2 more6 schema.org types in JSON-LD blocks on the home page: ContactPoint, ImageObject, Organization, PostalAddress, WebPage, WebSite.
OpenAPI linkNote none on the home pageNo OpenAPI link on the home page. It matters only for a site that ships an API.

Run the full check

The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for developers.cloudflare.com.

Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.

What the viewer does

It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.

Limits

  • Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
  • http and https only, default ports only. Private, local and internal addresses and names are refused.
  • Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
  • Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.

What it does not tell you

A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.

The seven flags

H1 in the initial HTML
Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
First 200 words in the initial HTML
Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
llms.txt present and linked
Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
Markdown on request
Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
Status of a made-up path
Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
JSON-LD types
The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
OpenAPI link
Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.

Sources

  1. Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
  2. Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
  3. Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
  4. Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
  5. Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
  6. Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
  7. llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026

Last reviewed 5 November 2026