The Plain Fetch viewer
In short
The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.
Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.
The page answers a plain fetch: 5 of 6 checks found.
Initial HTML what a plain fetch receives
<!DOCTYPE html>
<html lang="en">
<head>
<meta charSet="utf-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
[... 20 more head elements folded ...]
<title>Centinel Analytica | Bot and AI crawler protection
</title>
<meta name="description" content="Centinel Analytica detects real-browser automation, residential-proxy scrapers and spoofed AI crawlers, verifies trusted bots and applies your access policy."/>
[... 1 more head element folded ...]
<meta name="robots" content="max-image-preview:large"/>
<link rel="canonical" href="https://www.centinelanalytica.com"/>
<link rel="alternate" hrefLang="en" href="https://www.centinelanalytica.com"/>
<link rel="alternate" hrefLang="de" href="https://www.centinelanalytica.com/de"/>
<link rel="alternate" hrefLang="x-default" href="https://www.centinelanalytica.com"/>
<link rel="alternate" type="application/rss+xml" href="https://www.centinelanalytica.com/feed.xml" title="Centinel Blog"/>
[... 21 more head elements folded ...]
</head>
<body class="anothersans_53444a58-module__EGWvwG__className h-full bg-white antialiased [--pattern-fg:var(--color-charcoal-900)]/10 dark:bg-black dark:[--pattern-fg:var(--color-neutral-100)]/30">
<div hidden=""><!--$--><!--/$-->
</div><a href="#main-content" class="focus:text-charcoal-900 sr-only focus:not-sr-only focus:absolute focus:top-2 focus:left-2 focus:z-[100] focus:rounded focus:bg-white focus:px-4 focus:py-2">Skip to content</a>
<script type="application/ld+json">[... 1,509 characters folded ...]
</script>
<section hidden="" lang="en" data-nosnippet="" aria-label="Analytics notice" class="border-divide fixed inset-x-3 bottom-3 z-[90] mx-auto max-w-3xl rounded-2xl border bg-white p-3 shadow-xl sm:p-5 dark:bg-neutral-950">
<div class="flex items-center justify-between gap-3 sm:gap-4">
<p class="text-charcoal-700 text-xs leading-5 text-pretty sm:text-sm sm:leading-6 dark:text-neutral-200">We use analytics and marketing tools to understand visits and improve this site. Read our<!-- --> <a class="text-brand focus-visible:outline-brand rounded-sm underline underline-offset-4 focus-visible:outline-2" href="/data-privacy">data privacy policy</a>.
</p><button type="button" class="focus-visible:outline-brand inline-flex min-h-11 items-center justify-center rounded-xl px-6 py-2 text-center text-sm leading-6 font-medium transition-[background-color,border-color,color,box [... 295 characters folded ...]>Got it</button>
</div>
</section>
<div class="h-full bg-white dark:bg-black">
<header class="h-16">
<div class="border-divide fixed inset-x-0 top-0 z-[60] h-16 border-b backdrop-blur-md transition-[background-color,box-shadow] duration-150 ease-out motion-reduce:transition-none bg-white/95">
<nav aria-label="Primary navigation" class="mx-auto w-full max-w-7xl flex h-full items-center px-4 sm:px-6 lg:px-8 xl:px-0">
<div class="hidden h-full w-full items-center xl:flex"><a class="flex items-center gap-2" href="/">
<svg width="24" height="24" viewBox="0 0 48 48" fill="none" xmlns="http://www.w3.org/2000/svg">[... 176 characters folded ...]
</svg><span class="text-2xl font-medium">Centinel</span></a>
<div class="ml-12 flex h-full items-center gap-2">
<div class="relative flex h-full items-center"><button type="button" aria-expanded="false" aria-controls="nav-product" class="focus-visible:outline-brand inline-flex min-h-11 items-center gap-1.5 rounded-lg px-2 text-[15px] font-medium tracking-[-0.02em] transition-[ [... 160 characters folded ...]>Product
<svg aria-hidden="true" viewBox="0 0 12 12" class="size-3 transition-transform duration-150 ease-out motion-reduce:transition-none ">[... 132 characters folded ...]
</svg></button>
<div aria-hidden="true" inert="" class="fixed inset-x-4 top-16 mx-auto max-w-3xl pt-2 transition-[opacity,transform] duration-150 ease-out motion-reduce:transform-none motion-reduce:transition-none pointer-events-none -translate-y-1 opacity-0">
<div id="nav-product" class="grid w-full max-w-3xl grid-cols-[15rem_1fr] gap-2 rounded-2xl bg-white p-2 shadow-[0_0_0_1px_rgba(0,0,0,0.06),0_1px_2px_-1px_rgba(0,0,0,0.08),0_12px_32px_-8px_rgba(0,0,0,0.18)]"><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none p-4 bg-blue-50 hover:bg-blue-100" href="/bot-management"><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Platform overview</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">See how Centinel evaluates automated traffic and applies your access policy.</span></span></a>
<div class="grid gap-2 grid-cols-1">
<div class="grid content-start gap-1"><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 85 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>How it works</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Follow the request, evidence, and policy decision.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 85 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Integrations</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Connect Centinel to the stack you already run.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none p-4 hover:bg-gray-50 hover:shadow-[0_0_0_1px_rgba(0,0,0,0.05)]" href="/security"><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Security and data protection</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Certification, GDPR and the data Centinel processes.</span></span></a>
</div>
</div>
</div>
</div>
</div>
<div class="relative flex h-full items-center"><button type="button" aria-expanded="false" aria-controls="nav-solutions" class="focus-visible:outline-brand inline-flex min-h-11 items-center gap-1.5 rounded-lg px-2 text-[15px] font-medium tracking-[-0.02em] transition [... 162 characters folded ...]>Solutions
<svg aria-hidden="true" viewBox="0 0 12 12" class="size-3 transition-transform duration-150 ease-out motion-reduce:transition-none ">[... 132 characters folded ...]
</svg></button>
<div aria-hidden="true" inert="" class="fixed inset-x-4 top-16 mx-auto max-w-3xl pt-2 transition-[opacity,transform] duration-150 ease-out motion-reduce:transform-none motion-reduce:transition-none pointer-events-none -translate-y-1 opacity-0">
<div id="nav-solutions" class="grid w-full max-w-3xl grid-cols-[15rem_1fr] gap-2 rounded-2xl bg-white p-2 shadow-[0_0_0_1px_rgba(0,0,0,0.06),0_1px_2px_-1px_rgba(0,0,0,0.08),0_12px_32px_-8px_rgba(0,0,0,0.18)]"><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none p-4 bg-blue-50 hover:bg-blue-100" href="/use-cases"><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Explore all use cases</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">See how automated traffic targets content, accounts, transactions, APIs, and infrastructure.</span></span></a>
<div class="grid gap-2 grid-cols-2">
<div class="grid content-start gap-1">
<p class="px-4 pt-2 pb-1 text-xs font-semibold tracking-wide text-gray-600 uppercase">By use case
</p><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 115 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 856 characters folded ...]
</svg><span>Scraping and AI crawlers</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 107 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 852 characters folded ...]
</svg><span>Account takeover</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 117 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 893 characters folded ...]
</svg><span>Checkout and carding</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 123 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 1,294 characters folded ...]
</svg><span>Promo and account abuse</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 102 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 903 characters folded ...]
</svg><span>SMS pumping</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 100 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 967 characters folded ...]
</svg><span>API abuse</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 114 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" color="currentColor" class="text-brand size-[18px] shrink-0" stroke-width="1.8" stroke="currentColor" aria-hidden="true">[... 1,735 characters folded ...]
</svg><span>Traffic floods</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a>
</div>
<div class="grid content-start gap-1"><a class="px-4 pt-2 pb-1 text-xs font-semibold tracking-wide text-gray-600 uppercase hover:text-brand focus-visible:outline-brand rounded-lg transition-colors duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none" href="/industries">Industries<!-- --> <span aria-hidden="true">→</span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 112 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Media and publishing</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 112 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Retail and e-commerce</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 117 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Ticketing and live events</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 111 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Travel and airlines</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 110 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Banking and fintech</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 104 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Marketplaces</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 116 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Real estate and proptech</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span></span></a>
</div>
</div>
</div>
</div>
</div>
<div class="relative flex h-full items-center"><button type="button" aria-expanded="false" aria-controls="nav-resources" class="focus-visible:outline-brand inline-flex min-h-11 items-center gap-1.5 rounded-lg px-2 text-[15px] font-medium tracking-[-0.02em] transition [... 162 characters folded ...]>Resources
<svg aria-hidden="true" viewBox="0 0 12 12" class="size-3 transition-transform duration-150 ease-out motion-reduce:transition-none ">[... 132 characters folded ...]
</svg></button>
<div aria-hidden="true" inert="" class="fixed inset-x-4 top-16 mx-auto max-w-3xl pt-2 transition-[opacity,transform] duration-150 ease-out motion-reduce:transform-none motion-reduce:transition-none pointer-events-none -translate-y-1 opacity-0">
<div id="nav-resources" class="grid w-full max-w-3xl grid-cols-[15rem_1fr] gap-2 rounded-2xl bg-white p-2 shadow-[0_0_0_1px_rgba(0,0,0,0.06),0_1px_2px_-1px_rgba(0,0,0,0.08),0_12px_32px_-8px_rgba(0,0,0,0.18)]"><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none p-4 bg-blue-50 hover:bg-blue-100" href="/blog"><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Research and guides</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Methods for investigating and controlling automated traffic.</span></span></a>
<div class="grid gap-2 grid-cols-2">
<div class="grid content-start gap-1">
<p class="px-4 pt-2 pb-1 text-xs font-semibold tracking-wide text-gray-600 uppercase">Guides
</p><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 97 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Fake crawler report</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">How often Googlebot and AI crawler claims fail verification.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 101 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Verify crawler identities</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Check operator claims before applying a trusted rule.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 103 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Detect browser automation</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Build a layered and testable evidence model.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 108 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Write an access policy</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Match identity, resource, response, and failure behaviour.</span></span></a>
</div>
<div class="grid content-start gap-1">
<p class="px-4 pt-2 pb-1 text-xs font-semibold tracking-wide text-gray-600 uppercase">Tools and reference
</p><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible:outline-2 focus-visible:outline-offset-[-2px] motion-reduce:transition-none [... 87 characters folded ...]><span class="min-w-0"><span class="text-charcoal-900 flex items-center justify-between gap-3 text-sm font-semibold"><span class="flex min-w-0 items-center gap-2.5"><span>Check a crawler IP</span></span><span aria-hidden="true" class="text-brand transition-transform duration-150 ease-out group-hover:translate-x-1 group-focus-visible:translate-x-1 motion-reduce:transform-none motion-reduce:transition-none">→</span></span><span class="mt-2 block text-sm leading-5 text-gray-600">Test one address against the operator's own published evidence.</span></span></a><a class="group focus-visible:outline-brand rounded-lg text-pretty transition-[background-color,box-shadow] duration-150 ease-out focus-visible
Shown with 199 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; line breaks added before block tags because the source is minified; the pane stops after the first 200 words; the page is 269 KB.
Reading view the text a plain-fetch client can extract
title: Centinel Analytica | Bot and AI crawler protection
Bot and AI crawler protection for websites and apps
Skip to content We use analytics and marketing tools to understand visits and improve this site. Read our data privacy policy . Got it Centinel Product Platform overview→See how Centinel evaluates automated traffic and applies your access policy. How it works→Follow the request, evidence, and policy decision. Integrations→Connect Centinel to the stack you already run. Security and data protection→Certification, GDPR and the data Centinel processes. Solutions Explore all use cases→See how automated traffic targets content, accounts, transactions, APIs, and infrastructure. By use case Scraping and AI crawlers→ Account takeover→ Checkout and carding→ Promo and account abuse→ SMS pumping→ API abuse→ Traffic floods→ Industries → Media and publishing→ Retail and e-commerce→ Ticketing and live events→ Travel and airlines→ Banking and fintech→ Marketplaces→ Real estate and proptech→ Resources Research and guides→Methods for investigating and controlling automated traffic. Guides Fake crawler report→How often Googlebot and AI crawler claims fail verification. Verify crawler identities→Check operator claims before applying a trusted rule. Detect browser automation→Build a layered and testable evidence model. Write an access policy→Match identity, resource, response, and failure behaviour. Tools and reference Check a crawler IP→Test one address against the operator's own published evidence. Free tools→Parse a user agent, check a robots.txt file,
1129 more words follow in the initial HTML.
| Check | Result | Detail |
|---|---|---|
| H1 in the initial HTML | Found one H1 | First H1: Bot and AI crawler protection for websites and apps |
| First 200 words in the initial HTML | Found 200 of 200 words | The initial HTML carries 1329 words of visible text; the first 200 are marked in the left pane. |
| llms.txt present and linked | Found present and linked | 47460 bytes, 214 links. Structure grade B (5 of 6). The home page links it, which is how agents reached it in Ora's lab. |
| Markdown on request | Missing 200 text/html | Accept: text/markdown returned 200 with text/html; charset=utf-8. The server ignores the header. |
| Status of a made-up path | Found 404 | /agent-ready-html-missing-path-check returned 404: a real status code for a missing page. |
| JSON-LD types | Found Answer, FAQPage, ImageObject, Organization and 4 more | 8 schema.org types in JSON-LD blocks on the home page: Answer, FAQPage, ImageObject, Organization, Person, PostalAddress, Question, WebSite. |
| OpenAPI link | Note none on the home page | No OpenAPI link on the home page. It matters only for a site that ships an API. |
Run the full check
The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for centinel-analytica.com.
Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.
What the viewer does
It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.
Limits
- Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
- http and https only, default ports only. Private, local and internal addresses and names are refused.
- Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
- Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.
What it does not tell you
A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.
The seven flags
- H1 in the initial HTML
- Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
- First 200 words in the initial HTML
- Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
- llms.txt present and linked
- Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
- Markdown on request
- Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
- Status of a made-up path
- Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
- JSON-LD types
- The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
- OpenAPI link
- Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.
Sources
- Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
- Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
- Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
- Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
- Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
- Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026
Last reviewed 5 November 2026