Firecrawl llms.txt generator: what an agent reads
In short
Firecrawl llms.txt does not keep the file in sync with the site. Firecrawl llms.txt totals 3 of 6 on the eight numeric keys, from cited documentation read 4 November 2026. It also does not host or link the file. Firecrawl llms.txt: Firecrawl offered an alpha /llmstxt endpoint that turns any website into llms.txt and llms-full.txt files.
rubric.txt firecrawl-llmstxt
initial_html_by_default = n/a
real_status_codes = n/a
llms_txt_generation = 2
llms_txt_linking = 0
markdown_negotiation = n/a
jsonld_output = n/a
openapi_exposure = n/a
fenced_code = 1
total = 3 of 6
Read 2026-11-04. Documentation, not a test build.
Firecrawl llms.txt generator Edge or plugin product, Firecrawl
Crawl-based generator that writes llms.txt and llms-full.txt for any URL; the hosted /llmstxt endpoint is deprecated in favour of an open-source script.
Work left to the developer: Medium: run, edit the summary and sections, host and link the result, and rerun when content changes.
The nine scores
| Key | Score | Evidence | Source |
|---|---|---|---|
| Content in the initial HTML | n/a | A generator, not a host. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| Real status codes | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| llms.txt generation | 2, on by default | The product itself, from a crawl. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| llms.txt linking | 0, not offered | The site owner publishes and links the output. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| Markdown on request | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| JSON-LD output | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| OpenAPI exposure | n/a | A generator. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| Fenced, tagged code | 1, with setup | Output is crawled markdown; code fences depend on the source HTML. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | docs.firecrawl.dev/features/alpha/llmstxt, 2026-11-04 |
| Work left to the developer | Medium: run, edit the summary and sections, host and link the result, and rerun when content changes. One-off output. Not test-built: it needs a Firecrawl account and API key. Score from the documentation page cited, read 2026-11-04. | github.com/firecrawl/create-llmstxt-py, 2026-11-04 |
Test build
Not test-built: the scores above come from the documentation pages cited in each row, read 4 November 2026, because the platform needs an account or a paid plan. The reason is in each evidence cell.
What the documentation says
Each statement below carries its source and the date read. Statements a vendor makes about itself are labelled as vendor claims.
- Firecrawl offered an alpha /llmstxt endpoint that turns any website into llms.txt and llms-full.txt files. [primary source] source, read 4 November 2026.
- Firecrawl marks the endpoint as deprecated, remaining active but no longer maintained after 2025-06-30. [primary source, 2025-06-30] source, read 4 November 2026.
- Firecrawl points users to create-llmstxt-py, an open-source script that builds the files from its main endpoints. [primary source] source, read 4 November 2026.
- The web generator at llmstxt.firecrawl.dev asks for a Firecrawl API key for full generation. [primary source] source, read 4 November 2026.
- www.firecrawl.dev served its own 22,527-byte llms.txt on 2026-11-04 and answered Accept: text/markdown with text/markdown. [primary source] source, read 4 November 2026.
What it does not do
- Does not keep the file in sync with the site.
- Does not host or link the file.
Compare and replace
- Firecrawl llms.txt generator against Yoast and other WordPress llms.txt plugins
- Alternatives to Firecrawl llms.txt generator
- Firecrawl: vendor profile
- Firecrawl llms.txt generator home page
Sources
- Firecrawl docs: LLMs.txt generator endpoint https://docs.firecrawl.dev/features/alpha/llmstxt, read 4 November 2026
- create-llmstxt-py https://github.com/firecrawl/create-llmstxt-py, read 4 November 2026
- Firecrawl llms.txt generator https://llmstxt.firecrawl.dev/, read 4 November 2026
- firecrawl.dev https://www.firecrawl.dev/llms.txt, read 4 November 2026
Last reviewed 4 November 2026