What Is an llms.txt File
An llms.txt file is a plain-text Markdown file placed at your domain root that gives large language models a curated, structured map of your most important pages so they can find and understand your key content more easily.
What llms.txt is and why it exists
An llms.txt file is a proposed convention: a Markdown file served at the root of your domain, at /llms.txt, that offers large language models a concise, curated guide to your site. The idea is that raw HTML pages are noisy, full of navigation, scripts, and boilerplate, which makes them harder for a model to parse efficiently. A dedicated file lets you present a clean, prioritized outline of what matters most.
It is important to understand that llms.txt is an emerging, community-driven standard rather than a universally adopted requirement. Not every AI system reads it, and it does not replace good on-page content or crawlability. Think of it as a low-cost, forward-looking signal that clearly declares your most valuable pages and their purpose, complementing rather than substituting for the rest of your optimization work.
How to structure the file
The format is simple Markdown. Start with a top-level heading that names your site, followed by a short blockquote or paragraph summarizing what the site is about. Then use section headings to group links, with each link written as a Markdown link followed by a brief description of what that page contains. Keep descriptions factual and specific so a model understands each page's purpose at a glance.
Prioritize ruthlessly. The point of the file is curation, so list your most authoritative and useful pages: core documentation, key guides, product references, and important explainers. Avoid dumping every URL on the site. A common companion pattern is a fuller llms-full.txt containing expanded content, while llms.txt stays a lean index. Keep the file accurate and update it when your important pages change.
Write clean descriptions models can use
Each link description should read like a one-line abstract: what the page covers and who it helps. Avoid marketing language and vague phrasing. Because a model may use these descriptions to decide which page to consult, precise wording improves the odds it pulls the right source for a given question. Treat the descriptions with the same care you would give a good meta description.
Group related links under clear section headings so the structure itself communicates your site's information architecture. For example, separate sections for guides, reference, and product pages help a model navigate. Consistency between what your llms.txt promises and what the linked pages actually deliver builds trust in the file as a reliable map of your content.
Deploy it and keep it honest
Place the file at your domain root so it is reachable at yoursite.com/llms.txt, serve it as plain text, and make sure it is not blocked by access rules. Because the standard is still evolving, adopting it now is a modest bet: it costs little to publish and positions you well if adoption grows. Do not expect it alone to change your visibility overnight.
Maintain the file the way you would maintain a sitemap. When you publish important new content or restructure key pages, update the entries so the map stays current. An outdated or inaccurate llms.txt is worse than none, because it can point models to stale or missing pages. Keep it lean, accurate, and aligned with the actual content you want AI systems to surface.
Frequently asked questions
Is llms.txt an official standard that all AI systems follow?
No. It is an emerging, community-driven convention. Not every AI system reads it, so treat it as a low-cost complementary signal rather than a replacement for good content and crawlability.
Where do I put the llms.txt file?
Serve it as plain text at the root of your domain so it is reachable at yoursite.com/llms.txt, and make sure no access rules block it from being fetched.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a lean, curated index of your key pages with short descriptions, while llms-full.txt is an optional fuller file containing expanded content for models that want more detail.
Keep reading
Want this machine pointed at your site?
This page is one of a swarm we generated for ourselves. We build the same for you.
Get Started - $10,000