llms.txt
llms.txt is a plain-text manifest at a site's root that lists key pages, APIs, and docs in Markdown for AI crawlers to index efficiently. Proposed by Anthropic in 2024, it has become the de-facto 'robots.txt for the LLM era'.
llms.txt is a plain-text manifest at a site's root that lists key pages, APIs, and docs in Markdown for AI crawlers to index efficiently. Proposed by Anthropic in 2024, it has become the de-facto 'robots.txt for the LLM era'.
What is llms.txt?
llms.txt is a plain-text manifest at a site's root that lists key pages, APIs, and docs in Markdown for AI crawlers to index efficiently. Proposed by Anthropic in 2024, it has become the de-facto 'robots.txt for the LLM era'.
Details and examples
Format: ``` # Site Name > One-line description. ## Core Pages ``` llms-full.txt is the extended version — concatenate each page's core paragraph so an AI can understand the site without crawling.
Related terms
GEO (Generative Engine Optimization), robots.txt, AI Citation.
llms.txt · term at a glance
| Field | Value |
|---|---|
| Term | llms.txt |
| Category | Technical |
| Related | GEO (Generative Engine Optimization), robots.txt, AI Citation |
Frequently asked questions
What is llms.txt?
llms.txt is a plain-text manifest at a site's root that lists key pages, APIs, and docs in Markdown for AI crawlers to index efficiently. Proposed by Anthropic in 2024, it has become the de-facto 'robots.txt for the LLM era'.
References
By the 23SEOGEO team · Last updated: