--- title: "Firecrawl llms.txt: agent readability profile: Agent Ready HTML" description: "Firecrawl llms.txt scores 3 of 6 on the read-layer rubric: initial HTML, status codes, llms.txt, markdown, JSON-LD, OpenAPI and code. Read 2026-11-04." canonical: https://agentreadyhtml.com/platforms/firecrawl-llmstxt/ site: "Agent Ready HTML" last_updated: 2026-11-04 section: "Platforms" --- # Firecrawl llms.txt: agent readability profile: Agent Ready HTML > Firecrawl llms.txt scores 3 of 6 on the read-layer rubric: initial HTML, status codes, llms.txt, markdown, JSON-LD, OpenAPI and code. Read 2026-11-04. Source: https://agentreadyhtml.com/platforms/firecrawl-llmstxt/ Site: Agent Ready HTML Last reviewed: 2026-11-04 # Firecrawl llms.txt generator: what an agent reads In short Firecrawl llms.txt does not keep the file in sync with the site. Firecrawl llms.txt totals 3 of 6 on the eight numeric keys, from cited documentation read 4 November 2026. It also does not host or link the file. Firecrawl llms.txt: Firecrawl offered an alpha /llmstxt endpoint that turns any website into llms.txt and llms-full.txt files. **rubric.txt** firecrawl-llmstxt ```text initial_html_by_default = n/a real_status_codes = n/a llms_txt_generation = 2 llms_txt_linking = 0 markdown_negotiation = n/a jsonld_output = n/a openapi_exposure = n/a fenced_code = 1 total = 3 of 6 ``` Read 2026-11-04. Documentation, not a test build. **Firecrawl llms.txt generator** Edge or plugin product, Firecrawl Crawl-based generator that writes llms.txt and llms-full.txt for any URL; the hosted /llmstxt endpoint is deprecated in favour of an open-source script. Work left to the developer: Medium: run, edit the summary and sections, host and link the result, and rerun when content changes. ## The nine scores | Key | Score | Evidence | Source | | --- | --- | --- | --- | | Content in the initial HTML | n/a | A generator, not a host. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | Real status codes | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | llms.txt generation | 2, on by default | The product itself, from a crawl. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | llms.txt linking | 0, not offered | The site owner publishes and links the output. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | Markdown on request | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | JSON-LD output | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | OpenAPI exposure | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | Fenced, tagged code | 1, with setup | Output is crawled markdown; code fences depend on the source HTML. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 | | Work left to the developer | | Medium: run, edit the summary and sections, host and link the result, and rerun when content changes. One-off output. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | github.com/firecrawl/create-llmstxt-py, 2026-11-04 | ## Test build Not test-built: the scores above come from the documentation pages cited in each row, read 4 November 2026, because the platform needs an account or a paid plan. The reason is in each evidence cell. ## What the documentation says Each statement below carries its source and the date read. Statements a vendor makes about itself are labelled as vendor claims. - Firecrawl offered an alpha /llmstxt endpoint that turns any website into llms.txt and llms-full.txt files. \[primary source\] [source](https://docs.firecrawl.dev/features/alpha/llmstxt), read 4 November 2026. - Firecrawl marks the endpoint as deprecated, remaining active but no longer maintained after 2025-06-30. \[primary source, 2025-06-30\] [source](https://docs.firecrawl.dev/features/alpha/llmstxt), read 4 November 2026. - Firecrawl points users to create-llmstxt-py, an open-source script that builds the files from its main endpoints. \[primary source\] [source](https://github.com/firecrawl/create-llmstxt-py), read 4 November 2026. - The web generator at llmstxt.firecrawl.dev asks for a Firecrawl API key for full generation. \[primary source\] [source](https://llmstxt.firecrawl.dev/), read 4 November 2026. - www.firecrawl.dev served its own 22,527-byte llms.txt on 2026-11-04 and answered Accept: text/markdown with text/markdown. \[primary source\] [source](https://www.firecrawl.dev/llms.txt), read 4 November 2026. ## What it does not do - Does not keep the file in sync with the site. - Does not host or link the file. ## Compare and replace - [Firecrawl llms.txt generator against Yoast and other WordPress llms.txt plugins](https://agentreadyhtml.com/compare/firecrawl-llmstxt-vs-wordpress-llmstxt-plugins/) - [Alternatives to Firecrawl llms.txt generator](https://agentreadyhtml.com/platforms/firecrawl-llmstxt/alternatives/) - [Firecrawl: vendor profile](https://agentreadyhtml.com/vendors/firecrawl/) - [Firecrawl llms.txt generator home page](https://llmstxt.firecrawl.dev/) ## Sources 1. [Firecrawl docs: LLMs.txt generator endpoint](https://docs.firecrawl.dev/features/alpha/llmstxt) https://docs.firecrawl.dev/features/alpha/llmstxt, read 4 November 2026 2. [create-llmstxt-py](https://github.com/firecrawl/create-llmstxt-py) https://github.com/firecrawl/create-llmstxt-py, read 4 November 2026 3. [Firecrawl llms.txt generator](https://llmstxt.firecrawl.dev/) https://llmstxt.firecrawl.dev/, read 4 November 2026 4. [firecrawl.dev](https://www.firecrawl.dev/llms.txt) https://www.firecrawl.dev/llms.txt, read 4 November 2026 Last reviewed 4 November 2026 Edition Crawl 2026-11-04 Page updated 2026-11-04 Method How the viewer reads a page, how a file is graded and how a platform is scored: [the method page](https://agentreadyhtml.com/method/).