Agent Ready HTML

The Plain Fetch viewer

In short

The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.

Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.

GET https://auth0.com/ answered 200 with text/html, 440 KB, read 8 November 2026, 13:11 UTC.

Permalink: /viewer/?url=https://auth0.com/

The page answers a plain fetch: 5 of 6 checks found.

Initial HTML what a plain fetch receives

<!DOCTYPE html>
<html lang="en">
<head>
<title>Secure Authentication &amp; Ship Faster | Auth0
</title>
<meta charSet="utf-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=5"/>
[... 4 more head elements folded ...]
<meta name="description" content="Secure users, AI agents, and more with Auth0, a production-ready authentication and authorization platform built to help you ship faster and drive sign-ups."/>
[... 19 more head elements folded ...]
<link rel="canonical" href="https://auth0.com"/>
<link rel="alternate" hrefLang="en" href="https://auth0.com"/>
<link rel="alternate" hrefLang="de" href="https://auth0.com/de"/>
<link rel="alternate" hrefLang="fr" href="https://auth0.com/fr"/>
<link rel="alternate" hrefLang="ja" href="https://auth0.com/jp"/>
<link rel="alternate" hrefLang="es" href="https://auth0.com/es"/>
<link rel="alternate" hrefLang="pt" href="https://auth0.com/pt"/>
<link rel="alternate" hrefLang="x-default" href="https://auth0.com"/>
[... 66 more head elements folded ...]
</head>
<body>
<div id="__next"><!--$--><!--/$-->
<div class="sc-4069f831-2 bxdNIT">
</div>
<div class="sc-4069f831-1 dYKTJu">
</div>
<header class="sc-4069f831-3 cSSQNv">
<div class="sc-c04c8758-0 jehvvy">
<div class="sc-c04c8758-1 iRsvrI"><a class="sc-c04c8758-5 dzTkml"></a>
<div class="sc-c04c8758-6 gniXUa"><a href="/api/auth/login?redirectTo=dashboard" rel="external" class="sc-c04c8758-7 dLtnIm">Login</a>
<div class="sc-c04c8758-8 cJdxSn">
<div class="sc-c04c8758-10 ejsLvf"><span class="sc-c04c8758-12 VZAlT">
<svg width="20" height="20" viewBox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg" aria-hidden="true">[... 609 characters folded ...]
</svg></span><select aria-label="Language selector" class="sc-c04c8758-11 eClJMe"><option value="de" class="sc-c04c8758-9 hwxYFs">Deutsch</option><option value="en" class="sc-c04c8758-9 hwxYFs" selected="">English</option><option value="fr" class="sc-c04c8758-9 hwxYFs">Français</option><option value="es" class="sc-c04c8758-9 hwxYFs">Español</option><option value="pt" class="sc-c04c8758-9 hwxYFs">Português</option><option value="ja" class="sc-c04c8758-9 hwxYFs">日本語</option></select><span class="sc-c04c8758-13 laLchn">
<svg width="16" height="16" viewBox="0 0 16 16" fill="none" xmlns="http://www.w3.org/2000/svg">[... 269 characters folded ...]
</svg></span>
</div>
</div>
</div>
</div>
</div>
<nav aria-label="Mobile nav" class="sc-4069f831-9 jxjEZC"><a rel="external" href="/" aria-label="Auth0 logo" class="sc-4069f831-5 iiEqHc">
<svg xmlns="http://www.w3.org/2000/svg" width="106" height="40" viewBox="0 0 106 40" fill="none">[... 6,933 characters folded ...]
</svg></a>
<div class="sc-4069f831-10 hjUCNH"><button aria-label="Menu" aria-expanded="false" class="sc-4069f831-11 fMsNAI"><span class="sc-4069f831-12 kSxxgO"></span></button>
</div>
<section class="sc-e5c84330-0 flgBFR">
<ul class="sc-e5c84330-1 iwNldS">
<li class="sc-e5c84330-2 dmHhBG">
<p class="sc-e5c84330-5 YlRho">Build
</p>
<div class="sc-e5c84330-6 eUZHmZ">
<div class="sc-e5c84330-7 dZtfKF">
<p class="sc-e5c84330-8 ipcTia">Documentation
</p>
<ul class="sc-e5c84330-11 kTstJu">
<li class="sc-e5c84330-15 hQlYHz"><a href="/ai/docs/intro/overview" rel="external">AI Identity Docs</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/api" rel="external">APIs</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/libraries" rel="external">SDKs</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/events" rel="external">Events Catalog</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/changelog" rel="external">Changelog</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://developer.auth0.com/resources/code-samples" rel="external noreferrer" target="_blank">Code Samples<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://developer.auth0.com/resources/guides" rel="external noreferrer" target="_blank">Guides<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz">
<div class="sc-e5c84330-12 blEXya">
<div shape="button" class="sc-d3f58b63-12 eHbPuu"><a shape="button" href="https://auth0.com/docs" rel="external" class="sc-d3f58b63-14 yfHNp">Explore Auth0 Docs<span aria-hidden="true" class="sc-d3f58b63-15 eJMwuV">→</span></a>
</div>
</div>
</li>
</ul>
</div>
<div class="sc-e5c84330-7 dZtfKF">
<p class="sc-e5c84330-8 ipcTia">Quickstarts
</p>
<ul class="sc-e5c84330-11 kTstJu">
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/spa/react/interactive" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/react.fc0387fd.png" width="32" height="32" alt="" aria-hidden="true"/>React</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/webapp/nextjs" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/nextjs.96ac44aa.png" width="32" height="32" alt="" aria-hidden="true"/>Next.js</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/spa/angular" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/angular.26e2a9aa.png" width="32" height="32" alt="" aria-hidden="true"/>Angular</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/spa/vuejs" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/vue.b645b0be.png" width="32" height="32" alt="" aria-hidden="true"/>Vue.js</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/native/react-native" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/react-native.f69cfe0c.png" width="32" height="32" alt="" aria-hidden="true"/>React Native</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="/docs/quickstart/native/ios-swift" rel="external"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/swift.864d5dd8.png" width="32" height="32" alt="" aria-hidden="true"/>iOS / Swift</a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a rel="external">Build in 30+ of your favorite languages &amp; frameworks</a>
</li>
<li class="sc-e5c84330-15 hQlYHz">
<div class="sc-e5c84330-12 blEXya">
<div shape="button" class="sc-d3f58b63-12 eHbPuu"><a shape="button" href="/docs/quickstarts" rel="external" class="sc-d3f58b63-14 yfHNp">View all Quickstarts<span aria-hidden="true" class="sc-d3f58b63-15 eJMwuV">→</span></a>
</div>
</div>
</li>
</ul>
</div>
<div class="sc-e5c84330-7 dZtfKF">
<p class="sc-e5c84330-8 ipcTia">Developer Tools
</p>
<ul class="sc-e5c84330-11 kTstJu">
<li class="sc-e5c84330-15 hQlYHz"><a href="https://www.jwt.io" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/jwt.a6f0ac2d.png" width="32" height="32" alt="" aria-hidden="true"/>JWT Decoder<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://www.webauthn.me" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/webauthn.8573a203.png" width="32" height="32" alt="" aria-hidden="true"/>Webauthn Demo<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://www.openidconnect.net" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/oidc.523cf6d9.png" width="32" height="32" alt="" aria-hidden="true"/>OIDC Playground<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://www.samltool.io" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/saml.5323dd95.png" width="32" height="32" alt="" aria-hidden="true"/>SAML Tool<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://www.webauthn.me" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/passkey.f356236c.png" width="32" height="32" alt="" aria-hidden="true"/>Passkeys Playground<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://github.com/auth0/auth0-cli" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/auth0-deploy.bdaab92b.png" width="32" height="32" alt="" aria-hidden="true"/>Auth0 Deploy CLI<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://status.auth0.com/" rel="external noreferrer" target="_blank"><img src="/b2b-enterprise-identity-management/vercel/_next/static/media/auth0-status.6249ed03.png" width="32" height="32" alt="" aria-hidden="true"/>Auth0 Status<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
</ul>
</div>
<div class="sc-e5c84330-7 dZtfKF">
<p class="sc-e5c84330-8 ipcTia">Connect
</p>
<ul class="sc-e5c84330-11 kTstJu">
<li class="sc-e5c84330-15 hQlYHz"><a href="https://community.auth0.com/" rel="external noreferrer" target="_blank">Community<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://support.auth0.com/center/s/knowledge" rel="external noreferrer" target="_blank">Knowledge Base<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://support.auth0.com/center/s" rel="external noreferrer" target="_blank">Support Center<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://developer.auth0.com" rel="external noreferrer" target="_blank">Developer Center<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://marketplace.auth0.com" rel="external noreferrer" target="_blank">Marketplace<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
</li>
<li class="sc-e5c84330-15 hQlYHz"><a href="https://developer.auth0.com/events" rel="external noreferrer" target="_blank">Events<span aria-hidden="true" class="sc-e5c84330-16 iRNiwp">↗</span></a>
<ul class="sc-e5c84330-17 cDzzYv">

Shown with 85 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; line breaks added before block tags because the source is minified; the pane stops after the first 200 words; the page is 440 KB.

Reading view the text a plain-fetch client can extract

title: Secure Authentication & Ship Faster | Auth0

Convert, protect, & personalize every journey

Login DeutschEnglishFrançaisEspañolPortuguês日本語 Build Documentation AI Identity Docs APIs SDKs Events Catalog Changelog Code Samples↗ Guides↗ Explore Auth0 Docs→ Quickstarts React Next.js Angular Vue.js React Native iOS / Swift Build in 30+ of your favorite languages & frameworks View all Quickstarts→ Developer Tools JWT Decoder↗ Webauthn Demo↗ OIDC Playground↗ SAML Tool↗ Passkeys Playground↗ Auth0 Deploy CLI↗ Auth0 Status↗ Connect Community↗ Knowledge Base↗ Support Center↗ Developer Center↗ Marketplace↗ Events↗ Camp AI for Devs↗ Join us at Vercel Ship↗ Auth0 at MCP Dev Summit↗ Product AI IDENTITY B2B Commerce FEATURED CONTENT Webinar Streamcast: Agentic Commerce CUSTOMER IDENTITY Universal Login Passwordless User Management Authentication Breached Passwords Embedded Login Solutions USE CASES Enterprise B2B SaaS B2B Connect B2C Startups Nonprofits WHO IT’S FOR Financial Services Healthcare Retail Partners Library EXPLORE BY TOPIC AI Developers Identity & Security Business Engineering Announcements Visit the blog→ EXPLORE BY TYPE Ebooks Videos Podcasts Webinars Upcoming Webinars Whitepapers Browse resources→ Pricing Language DeutschEnglishFrançaisEspañolPortuguês日本語 Sign up Login Let's connect Build Documentation AI Identity Docs APIs SDKs Events Catalog Changelog Code Samples↗ Guides↗ Explore Auth0 Docs→ Quickstarts React Next.js Angular Vue.js React Native iOS / Swift Build in 30+ of your favorite languages & frameworks View all Quickstarts→ Developer Tools JWT Decoder↗

2111 more words follow in the initial HTML.

5 found, 0 missing, 2 notes, from 7 checks run

  • H1Found
  • 200 wordsFound
  • llms.txtNote
  • MarkdownFound
  • Missing pathFound
  • JSON-LDFound
  • OpenAPINote
What a plain fetch found on auth0.com
CheckResultDetail
H1 in the initial HTMLFound one H1First H1: Convert, protect, & personalize every journey
First 200 words in the initial HTMLFound 200 of 200 wordsThe initial HTML carries 2311 words of visible text; the first 200 are marked in the left pane.
llms.txt present and linkedNote present, not linked4232 bytes, 41 links. Structure grade A (6 of 6). Nothing on the home page points to it. Ora's lab found 86 percent of llms.txt fetches arrived through a link.
Markdown on requestFound text/markdownAccept: text/markdown returned 200 with text/markdown; charset=utf-8. Vary: Accept is set.
Status of a made-up pathFound 404/agent-ready-html-missing-path-check returned 404: a real status code for a missing page.
JSON-LD typesFound BreadcrumbList, ContactPoint, ListItem, Offer and 7 more11 schema.org types in JSON-LD blocks on the home page: BreadcrumbList, ContactPoint, ListItem, Offer, Organization, PostalAddress, SearchAction, SoftwareApplication, SpeakableSpecification, WebPage, WebSite.
OpenAPI linkNote none on the home pageNo OpenAPI link on the home page. It matters only for a site that ships an API.

Run the full check

The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for auth0.com.

Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.

What the viewer does

It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.

Limits

  • Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
  • http and https only, default ports only. Private, local and internal addresses and names are refused.
  • Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
  • Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.

What it does not tell you

A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.

The seven flags

H1 in the initial HTML
Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
First 200 words in the initial HTML
Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
llms.txt present and linked
Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
Markdown on request
Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
Status of a made-up path
Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
JSON-LD types
The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
OpenAPI link
Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.

Sources

  1. Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
  2. Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
  3. Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
  4. Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
  5. Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
  6. Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
  7. llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026

Last reviewed 5 November 2026