Agent Ready HTML

The Plain Fetch viewer

In short

The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.

Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.

GET https://rubiconproject.com/ answered 200 with text/html, 174 KB, 2 redirects, read 8 November 2026, 13:31 UTC. Final URL: https://www.magnite.com/.

Permalink: /viewer/?url=https://rubiconproject.com/

The page answers a plain fetch: 4 of 6 checks found.

Initial HTML what a plain fetch receives

<!doctype html>
<html lang="en-US">
<head>
[... 3 more head elements folded ...]
<meta charset="UTF-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name='robots' content='index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1, noarchive' />
<link rel="alternate" hreflang="en" href="https://www.magnite.com/" />
<link rel="alternate" hreflang="fr" href="https://www.magnite.com/fr/" />
<link rel="alternate" hreflang="de" href="https://www.magnite.com/de/" />
<link rel="alternate" hreflang="it" href="https://www.magnite.com/it/" />
<link rel="alternate" hreflang="ja" href="https://www.magnite.com/ja/" />
<link rel="alternate" hreflang="pt" href="https://www.magnite.com/pt-pt/" />
<link rel="alternate" hreflang="es" href="https://www.magnite.com/es/" />
<link rel="alternate" hreflang="x-default" href="https://www.magnite.com/" />
[... 1 more head element folded ...]
<title>Magnite - The Largest Independent Sell-Side Advertising Company</title>
<meta name="description" content="The world&#039;s top publishers trust Magnite to help them drive more advertising revenue across every channel and format, including CTV." />
<link rel="canonical" href="https://www.magnite.com/" />
[... 24 more head elements folded ...]
<meta name="generator" content="WPML ver:5.2.0 stt:1,4,3,27,28,41,2;" />
[... 5 more head elements folded ...]
</head>
<body class="home wp-singular page-template-default page page-id-220 wp-custom-logo wp-embed-responsive wp-theme-magnite-rebuild">
	<!-- Google Tag Manager (noscript) -->
	<noscript>[... 154 characters folded ...]</noscript>
	<!-- End Google Tag Manager (noscript) -->


<header class="header sticky z-30 top-0 transition-transform duration-300" data-header-container>
	
	<div class="hidden md:block relative z-20 bg-[#E6E6E6]" data-top-bar>
		<div class="container max-w-1344px">
			<ul class="flex items-center justify-end gap-6">
				<li class="py-9px">
					<button class="flex items-center gap-1.5 text-sm leading-[1.2857142857]" type="button"
							data-search-open>
						<span>Search</span>
						<span class="shrink-0 pt-1">
						<svg width="12" height="12" viewBox="0 0 12 12" fill="none"
							 xmlns="http://www.w3.org/2000/svg">[... 303 characters folded ...]</svg>
					</span>
					</button>
				</li>
									
					<li class="relative py-9px group">
						<button class="flex items-center gap-1.5 text-sm leading-[1.2857142857]" type="button">
							<span>Login</span>

															<svg class="shrink-0 mt-1" width="8" height="5" viewBox="0 0 8 5" fill="none"
									 xmlns="http://www.w3.org/2000/svg">
									<path d="M1 0.5L4 3.5L7 0.5" stroke="#222222"/>
								</svg>
													</button>

													<ul class="grid absolute top-full right-0 z-10 min-w-[100px] bg-white border border-brand-black shadow-[0px_4px_8px_0px_rgba(0,0,0,0.10)] opacity-0 pointer-events-none group-hover:opacity-100 group-hover:pointer-events-auto group/top-bar-menu">
																	<li>
										<a class="flex justify-end py-6px px-20px text-right text-brand-black text-14px leading-21px md:hover:bg-[#F2F2F2] md:group-hover/top-bar-menu:text-[#747474] md:hover:!text-brand-black"
										   href="https://apps.rubiconproject.com/"
										   target="_blank">
											<span>DV+</span>
										</a>
									</li>
																	<li>
										<a class="flex justify-end py-6px px-20px text-right text-brand-black text-14px leading-21px md:hover:bg-[#F2F2F2] md:group-hover/top-bar-menu:text-[#747474] md:hover:!text-brand-black"
										   href="https://apps.magnite.com/clearline"
										   target="_blank">
											<span>Clearline</span>
										</a>
									</li>
																	<li>
										<a class="flex justify-end py-6px px-20px text-right text-brand-black text-14px leading-21px md:hover:bg-[#F2F2F2] md:group-hover/top-bar-menu:text-[#747474] md:hover:!text-brand-black"
										   href="https://apps.magnite.com/"
										   target="_self">
											<span>SpringServe</span>
										</a>
									</li>
															</ul>
											</li>
																			
									<li class="relative py-9px group">
						<button class="flex items-center gap-1.5 text-sm leading-[1.2857142857]" type="button">
							<span>Language</span>

							<svg class="shrink-0 mt-1" width="8" height="5" viewBox="0 0 8 5" fill="none"
								 xmlns="http://www.w3.org/2000/svg">
								<path d="M1 0.5L4 3.5L7 0.5" stroke="#222222"/>
							</svg>
						</button>

						<div
							class="language-widget">
							
<div role="navigation" aria-label="Language Switcher" class="wpml-ls-statics-shortcode_actions wpml-ls wpml-ls-touch-device wpml-ls-legacy-list-vertical">
	<ul>

					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-en wpml-ls-current-language wpml-ls-first-item wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/" hreflang="en" lang="en" class="wpml-ls-link" aria-current="page" aria-label="Switch to English" title="Switch to English">
					<span class="wpml-ls-native">English</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-fr wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/fr/" hreflang="fr" lang="fr" class="wpml-ls-link" aria-label="Switch to French" title="Switch to French">
					<span class="wpml-ls-display">French</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-de wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/de/" hreflang="de" lang="de" class="wpml-ls-link" aria-label="Switch to German" title="Switch to German">
					<span class="wpml-ls-display">German</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-it wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/it/" hreflang="it" lang="it" class="wpml-ls-link" aria-label="Switch to Italian" title="Switch to Italian">
					<span class="wpml-ls-display">Italian</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-ja wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/ja/" hreflang="ja" lang="ja" class="wpml-ls-link" aria-label="Switch to Japanese" title="Switch to Japanese">
					<span class="wpml-ls-display">Japanese</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-pt-pt wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/pt-pt/" hreflang="pt" lang="pt" class="wpml-ls-link" aria-label="Switch to Portuguese" title="Switch to Portuguese">
					<span class="wpml-ls-display">Portuguese</span></a>
			</li>
					<li class="wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-es wpml-ls-last-item wpml-ls-item-legacy-list-vertical">
				<a href="https://www.magnite.com/es/" hreflang="es" lang="es" class="wpml-ls-link" aria-label="Switch to Spanish" title="Switch to Spanish">
					<span class="wpml-ls-display">Spanish</span></a>
			</li>
		
	</ul>
</div>
						</div>
					</li>
							</ul>
		</div>
	</div>

	<div class="bg-white pt-19px pb-3 md:py-0">
		<div class="container max-w-1344px flex items-start sm:items-center justify-between gap-5">
			<div class="shrink-0 md:pt-6px">
				<a href="https://www.magnite.com/">
					<img width="99" height="32" src="https://www.magnite.com/wp-content/uploads/2023/04/Logo.svg" class="block w-[99px] sm:w-[148px] h-8 sm:h-12" alt="Magnite Logo" decoding="async" />				</a>
			</div>
			<div class="flex items-center gap-6 md:hidden">

Shown with 104 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; the pane stops after the first 200 words; the page is 174 KB.

Reading view the text a plain-fetch client can extract

title: Magnite - The Largest Independent Sell-Side Advertising Company

Stay ahead of what’s next. Build with us.

Search Login DV+ Clearline SpringServe Language English French German Italian Japanese Portuguese Spanish Open Search Form Open Menu Close Search Sellers Buyers Insights Insights Blog Magnite Is Now Live as a Bidder on CloudX Magnite Is Now Live as a Bidder on CloudX The Intelligence Shift: Why Smarter Advertising Is Moving Closer to Media The Intelligence Shift: Why Smarter Advertising Is Moving Closer to Media Case Studies How BDG Media Achieved CPM Lift at Increasing Scale with Magnite’s Prebid Yield Optimization How BDG Media Achieved CPM Lift at Increasing Scale with Magnite’s Prebid Yield Optimization Dentsu CTV Marketplace Powered by Magnite: Powering Smarter CTV for Cadillac Dentsu CTV Marketplace Powered by Magnite: Powering Smarter CTV for Cadillac Events Magnite University Research Inside The Live Experience Inside The Live Experience Streams & Screens: Hong Kong Streams & Screens: Hong Kong Topics Topics Streaming Live Artificial Intelligence Addressability Monetization Media buying Commerce Media Bringing Intelligence Into the Auction: The Rise of Real-Time Data, Containerization and Smarter Supply Bringing Intelligence Into the Auction: The Rise of Real-Time Data, Containerization and Smarter Supply Introducing Magnite Orchestration: Powering the Future of Agentic Advertising Introducing Magnite Orchestration: Powering the Future of Agentic Advertising About Us About

662 more words follow in the initial HTML.

4 found, 1 missing, 2 notes, from 7 checks run

  • H1Found
  • 200 wordsFound
  • llms.txtNote
  • MarkdownMissing
  • Missing pathFound
  • JSON-LDFound
  • OpenAPINote
What a plain fetch found on rubiconproject.com
CheckResultDetail
H1 in the initial HTMLFound one H1First H1: Stay ahead of what’s next. Build with us.
First 200 words in the initial HTMLFound 200 of 200 wordsThe initial HTML carries 862 words of visible text; the first 200 are marked in the left pane.
llms.txt present and linkedNote present, not linked6420 bytes, 63 links. Structure grade B (5 of 6). Nothing on the home page points to it. Ora's lab found 86 percent of llms.txt fetches arrived through a link.
Markdown on requestMissing 200 text/htmlAccept: text/markdown returned 200 with text/html; charset=UTF-8. The server ignores the header.
Status of a made-up pathFound 404/agent-ready-html-missing-path-check returned 404: a real status code for a missing page.
JSON-LD typesFound BreadcrumbList, EntryPoint, ImageObject, ListItem and 6 more10 schema.org types in JSON-LD blocks on the home page: BreadcrumbList, EntryPoint, ImageObject, ListItem, Organization, PropertyValueSpecification, ReadAction, SearchAction, WebPage, WebSite.
OpenAPI linkNote none on the home pageNo OpenAPI link on the home page. It matters only for a site that ships an API.

Run the full check

The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for rubiconproject.com.

Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.

What the viewer does

It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.

Limits

  • Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
  • http and https only, default ports only. Private, local and internal addresses and names are refused.
  • Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
  • Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.

What it does not tell you

A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.

The seven flags

H1 in the initial HTML
Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
First 200 words in the initial HTML
Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
llms.txt present and linked
Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
Markdown on request
Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
Status of a made-up path
Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
JSON-LD types
The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
OpenAPI link
Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.

Sources

  1. Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
  2. Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
  3. Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
  4. Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
  5. Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
  6. Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
  7. llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026

Last reviewed 5 November 2026