llms.txt

A plain-text file at the root of your domain that helps AI agents navigate your most important pages.

Definition

llms.txt is an emerging convention (inspired by robots.txt) that places a human- and machine-readable orientation file at `yourdomain.com/llms.txt`. It typically lists key pages with brief descriptions in a concise Markdown format, giving AI agents a structured guide without requiring them to crawl the full site. It is not yet an official standard but is being adopted by developer-focused sites.

Why it matters for AI visibility

As AI agents increasingly browse the web on behalf of users, a well-maintained llms.txt helps ensure they find your canonical product, documentation, and support pages first — rather than discovering outdated or marketing-only content by accident.

Structured Data (JSON-LD)Machine-readable markup that gives AI systems explicit facts about your organization, products, and content.

robots.txtA plain-text file at the root of your domain that tells crawlers which paths they may or may not fetch.

Answer-Ready ContentPages structured to directly answer the questions buyers ask AI systems when evaluating options.

↗ Checklist: llms.txtAn llms.txt file gives language models and agents a concise guide to your most important public pages.

Check your site

The free scan checks crawler access, robots.txt, sitemap, structured data, and discoverability — and turns the results into a prioritized fix list.

Run the free scan →Back to glossary