> Markdown for /glossary/llms-txt. Visit the full page for interactive content.

[Back to glossary](/glossary)

# llms.txt

A proposed standard (by Jeremy Howard) for controlling AI crawler access to site content. Placed at domain root, it specifies permitted/blocked crawlers, key...

A proposed standard (by Jeremy Howard) for controlling AI crawler access to site content. Placed at domain root, it specifies permitted/blocked crawlers, key page URLs, and content summaries. Improves AI discoverability and citation accuracy by giving LLM crawlers a structured map of the site's most important content.

**Example:** An llms.txt file at example.com/llms.txt lists: '## Key Pages\\n- /product: Our main SaaS product\\n- /docs: API documentation\\n- /blog: Industry insights' — helping GPTBot and PerplexityBot prioritise crawling.


---
*Content served via ServeMD for LLM consumption*