The Plain Fetch viewer
In short
The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.
Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.
The page answers a plain fetch: 3 of 6 checks found.
Initial HTML what a plain fetch receives
<!DOCTYPE html>
<html data-dpl-id="dpl_E7an3eJ42SqcW49KzWKBrKNrTEew" lang="en-US" data-os="mac" data-device="default" class="Sj65MG_variable aDRXRq_variable -Zg_XW_variable _8qwdia_variable">
<head>
<meta charSet="utf-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
[... 47 more head elements folded ...]
<title>AI Coding Agent for Building Ambitious Software | Cursor
</title>
<meta name="description" content="Built to make you extraordinarily productive, agents turn ideas into code. Accelerate development by handing off tasks to Cursor."/>
[... 1 more head element folded ...]
<link rel="canonical" href="https://cursor.com"/>
<link rel="alternate" hrefLang="en-US" href="https://cursor.com"/>
<link rel="alternate" hrefLang="zh" href="https://cursor.com/cn/"/>
<link rel="alternate" hrefLang="ja" href="https://cursor.com/ja/"/>
<link rel="alternate" hrefLang="zh-Hant" href="https://cursor.com/zh-Hant/"/>
<link rel="alternate" hrefLang="es" href="https://cursor.com/es/"/>
<link rel="alternate" hrefLang="fr" href="https://cursor.com/fr/"/>
<link rel="alternate" hrefLang="pt-BR" href="https://cursor.com/pt-BR/"/>
<link rel="alternate" hrefLang="ko" href="https://cursor.com/ko/"/>
<link rel="alternate" hrefLang="de" href="https://cursor.com/de/"/>
<link rel="alternate" hrefLang="hi" href="https://cursor.com/hi/"/>
[... 21 more head elements folded ...]
</head>
<body class="bg-theme-bg text-theme-text min-h-screen pt-[var(--site-header-height)]">
<div hidden=""><!--$--><!--/$-->
</div><!--&-->
<noscript>[... 140 characters folded ...]
</noscript>
<script nonce="5rKBgTFflmyqGJgUK4yAFg==">[... 226 characters folded ...]
</script>
<script nonce="5rKBgTFflmyqGJgUK4yAFg==">[... 950 characters folded ...]
</script>
<script nonce="5rKBgTFflmyqGJgUK4yAFg==" type="application/ld+json">[... 616 characters folded ...]
</script>
<script nonce="5rKBgTFflmyqGJgUK4yAFg==" type="application/ld+json">[... 251 characters folded ...]
</script><!--$?--><template id="B:0"></template><!--/$--><!--$?--><template id="B:1"></template><!--/$--><!--$?--><template id="B:2"></template><!--/$--><!--$?--><template id="B:7"></template>
<script nonce="5rKBgTFflmyqGJgUK4yAFg==">[... 542 characters folded ...]
</script>
<header id="site-header" class="bg-theme-bg px-g2 fixed top-0 left-0 z-50 w-full">
<div class="relative z-2 container grid h-[var(--site-header-height)] grid-cols-[1fr_auto_auto] items-center lg:grid-cols-[auto_1fr_auto]"><a href="#main" class="skipnav btn btn--sm">Skip to content</a>
<div class="col-start-1 col-end-2 row-start-1 row-end-2"><a class="focus-visible:focus-visible relative top-[0.2rem] left-[-2px] inline-flex" aria-label="Homepage" href="/home">
<svg fill="none" class="w-[95.37px] lg:w-[95.75px]" viewBox="0 0 2193 545" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" overflow="visible">[... 2,421 characters folded ...]
</svg><span class="sr-only">Cursor</span></a>
</div>
<div class="hidden lg:block">
<nav class="absolute top-1/2 left-1/2 -translate-x-1/2 -translate-y-1/2" role="navigation">
<ul class="flex items-center justify-center">
<li class="relative"><a class="nav__btn" href="/grok">Models</a><button class="nav__btn-caret nav__btn-caret--sm icon-glyph-09" type="button" aria-label="Expand Menu" aria-expanded="false"><span class="nav__btn-caret__icon" aria-hidden="true">↓</span></button>
<div class="nav__sub-nav pt-v3/12 absolute top-full left-0">
<div class="card card--sub-nav card--flyout type-sm shadow-[var(--shadow-flyout)]">
<ul class="flex flex-col">
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/grok">Grok</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/evals">Evals</a>
</li>
</ul>
</div>
</div>
</li>
<li class="relative"><a class="nav__btn" href="/product">Product</a><button class="nav__btn-caret nav__btn-caret--sm icon-glyph-09" type="button" aria-label="Expand Menu" aria-expanded="false"><span class="nav__btn-caret__icon" aria-hidden="true">↓</span></button>
<div class="nav__sub-nav pt-v3/12 absolute top-full left-0">
<div class="card card--sub-nav card--flyout type-sm shadow-[var(--shadow-flyout)]">
<ul class="flex flex-col">
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/product">Agents</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/cloud">Cloud</a>
</li>
<li class="min-w-[8rem]"><a target="_blank" rel="noopener noreferrer" class="nav__sub-nav__link py-v2.5/12" href="https://x.ai/bot">Grok Bot<span class="nav__sub-nav__link__icon"> ↗</span></a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/mobile">Mobile</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/automate">Automations</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/cli">CLI</a>
</li>
<li class="min-w-[8rem]"><a target="_blank" rel="noopener noreferrer" class="nav__sub-nav__link py-v2.5/12" href="https://cursor.com/marketplace">Marketplace<span class="nav__sub-nav__link__icon"> ↗</span></a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/bugbot">Review</a>
</li>
</ul>
</div>
</div>
</li>
<li><a class="nav__link" href="/enterprise">Enterprise</a>
</li>
<li><a class="nav__link" href="/pricing">Pricing</a>
</li>
<li class="relative"><a class="nav__btn" href="/changelog">Resources</a><button class="nav__btn-caret nav__btn-caret--sm icon-glyph-09" type="button" aria-label="Expand Menu" aria-expanded="false"><span class="nav__btn-caret__icon" aria-hidden="true">↓</span></button>
<div class="nav__sub-nav pt-v3/12 absolute top-full left-0">
<div class="card card--sub-nav card--flyout type-sm shadow-[var(--shadow-flyout)]">
<ul class="gap-x-g1 grid grid-cols-[repeat(2,auto)]">
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/changelog">Changelog</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/blog">Blog</a>
</li>
<li class="min-w-[8rem]"><a href="/docs" target="_blank" rel="noopener noreferrer" class="nav__sub-nav__link py-v2.5/12">Docs</a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/community">Community</a>
</li>
<li class="min-w-[8rem]"><a target="_blank" rel="noopener noreferrer" class="nav__sub-nav__link py-v2.5/12" href="https://cursor.com/help">Help<span class="nav__sub-nav__link__icon"> ↗</span></a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/workshops">Workshops</a>
</li>
<li class="min-w-[8rem]"><a target="_blank" rel="noopener noreferrer" class="nav__sub-nav__link py-v2.5/12" href="https://forum.cursor.com/">Forum<span class="nav__sub-nav__link__icon"> ↗</span></a>
</li>
<li class="min-w-[8rem]"><a class="nav__sub-nav__link py-v2.5/12" href="/careers">Careers</a>
</li>
</ul>
</div>
</div>
</li>
</ul>
</nav>
</div>
<div class="block lg:hidden">
<div class="col-start-4 col-end-[-1] row-start-1 row-end-2 flex items-center justify-center"><button type="button" class="focus-visible:focus-visible w-v1.5 h-v1.5 relative inline-flex cursor-pointer items-center justify-center after:absolute after:inset-[-0.5rem] after:content-[''] ml-g1 -mr-[0.3rem]" aria-label="Open navigation" aria-expanded="false">
<svg xmlns="http://www.w3.org/2000/svg" fill="none" viewBox="0 0 24 24" stroke-width="1.125" stroke="currentColor" width="100%" height="100%"><path stroke-linecap="round" stroke-linejoin="round" d="M3.75 6.75h16.5M3.75 12h16.5m-16.5 5.25h16.5"></path>
</svg></button>
<nav class="bg-theme-bg px-g2 fixed inset-0 z-50 flex flex-col overscroll-contain transition-opacity pointer-events-none opacity-0" style="transition:opacity var(--duration) var(--ease-out-spring)" role="navigation">
<header class="type-lg mb-v3 flex h-[var(--site-header-height)] shrink-0 items-center justify-end"><button type="button" class="focus-visible:focus-visible w-v1.5 h-v1.5 relative inline-flex cursor-pointer items-center justify-center after:absolute after:inset-[-0.5rem] after:content-[''] z-51 -mr-[0.3rem]" aria-label="Close navigation">
<svg width="100%" height="100%" viewBox="0 0 24 24" fill="none" stroke-width="1.25" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="h-full w-full"><path d="M6 18L18 6M6 6l12 12" stroke-linecap="round" stroke-linejoin="round"></path>
</svg></button>
</header>
<div class="min-h-0 flex-1 overflow-y-auto">
<ul class="flex flex-col">
<li class="relative"><button class="nav-sm-item type-lg focus-visible:focus-visible py-v3/12 flex w-full cursor-pointer items-center" type="button" aria-expanded="false">Models<span class="nav-sm-caret" aria-hidden="true"> →</span></button>
</li>
<li class="relative"><button class="nav-sm-item type-lg focus-visible:focus-visible py-v3/12 flex w-full cursor-pointer items-center" type="button" aria-expanded="false">Product<span class="nav-sm-caret" aria-hidden="true"> →</span></button>
</li>
<li class="">
<div><a class="type-lg focus-visible:focus-visible py-v3/12 block" href="/enterprise">Enterprise</a>
</div>
</li>
<li class="">
<div><a class="type-lg focus-visible:focus-visible py-v3/12 block" href="/pricing">Pricing</a>
</div>
</li>
<li class="relative"><button class="nav-sm-item type-lg focus-visible:focus-visible py-v3/12 flex w-full cursor-pointer items-center" type="button" aria-expanded="false">Resources<span class="nav-sm-caret" aria-hidden="true"> →</span></button>
</li>
</ul>
Shown with 247 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; line breaks added before block tags because the source is minified; the pane stops after the first 200 words; the page is 576 KB.
Reading view the text a plain-fetch client can extract
title: AI Coding Agent for Building Ambitious Software | Cursor
Cursor is your coding agent for building ambitious software.
Skip to content Cursor Models ↓ Grok Evals Product ↓ Agents Cloud Grok Bot ↗ Mobile Automations CLI Marketplace ↗ Review Enterprise Pricing Resources ↓ Changelog Blog Docs Community Help ↗ Workshops Forum ↗ Careers Models → Product → Enterprise Pricing Resources → Sign in ContactContact sales Download Cursor is your coding agent for building ambitious software. Download for macOS ⤓ Get started → Request a demo → This element contains an interactive demo for sighted users showing multiple Cursor interfaces: Cursor Desktop interface, Cursor CLI interface. The interface is displayed over a subtle, solid brand background. Cursor Desktop Get Cursor In Progress 2 Build Landing Page Reading docs Plan Mission Control Generating plan Ready for Review 3 PyTorch MNIST Experiments 10m PyTorch MNIST Experiments Set up Cursor Rules for Dashboard 30m Set up Cursor Rules for Dashboard Bioinformatics Tools 45m + 135- 21·Bioinformatics Tools http://localhost:3000 Acme Labs Software creation is changing. We are a group of researchers, engineers, and technologists inventing at the edge of what's useful and possible. We have much to learn, try, and build. See projects Join our team → 2026 Secure codebase indexing Published 2026 Semantic search Published 2025 Reinforcement learning Published 2024 Shadow workspaces
2556 more words follow in the initial HTML.
| Check | Result | Detail |
|---|---|---|
| H1 in the initial HTML | Found 2 H1 elements | First H1: Cursor is your coding agent for building ambitious software. |
| First 200 words in the initial HTML | Found 200 of 200 words | The initial HTML carries 2756 words of visible text; the first 200 are marked in the left pane. |
| llms.txt present and linked | Note present, not linked | 27834 bytes, 0 links. Structure grade D (3 of 6). Nothing on the home page points to it. Ora's lab found 86 percent of llms.txt fetches arrived through a link. |
| Markdown on request | Missing 200 text/html | Accept: text/markdown returned 200 with text/html; charset=utf-8. The server ignores the header. |
| Status of a made-up path | Missing 200 (soft 404) | /agent-ready-html-missing-path-check returned 200. A missing page that answers 200 looks like a live page to an agent. |
| JSON-LD types | Found ContactPoint, ImageObject, Organization, WebSite | 4 schema.org types in JSON-LD blocks on the home page: ContactPoint, ImageObject, Organization, WebSite. |
| OpenAPI link | Note none on the home page | No OpenAPI link on the home page. It matters only for a site that ships an API. |
Run the full check
The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for cursor.com.
Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.
What the viewer does
It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.
Limits
- Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
- http and https only, default ports only. Private, local and internal addresses and names are refused.
- Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
- Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.
What it does not tell you
A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.
The seven flags
- H1 in the initial HTML
- Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
- First 200 words in the initial HTML
- Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
- llms.txt present and linked
- Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
- Markdown on request
- Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
- Status of a made-up path
- Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
- JSON-LD types
- The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
- OpenAPI link
- Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.
Sources
- Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
- Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
- Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
- Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
- Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
- Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026
Last reviewed 5 November 2026