llms.txt

llms.txt is a proposed standard for a plain-text Markdown file at the root of a website that gives AI models a short guide to the site’s most useful content.

Area

SEO and AEO

What it means in practice

Jeremy Howard of Answer.AI published the proposal in 2024. The file sits at yoursite.com/llms.txt. It opens with the site or company name and a short summary, then lists links to key pages with one-line descriptions, grouped under headings. Some sites also publish an llms-full.txt with the full text of important pages.

The idea is that AI tools, especially ones reading a site the moment a user asks a question, can understand it faster from a curated summary than by parsing complex HTML. Think of it as a sitemap written for language models.

Support is uneven. Some developer tools and documentation platforms use it, and major AI search providers haven’t clearly confirmed that they rely on it. Treat it as a cheap extra alongside clear pages and good structure.

Why it matters for B2B and AI teams

For B2B and AI companies, especially those with developer docs or APIs, an llms.txt file is a cheap way to point AI tools at accurate, current information.

Writing one is a useful exercise anyway. A short summary of what the company does and which pages matter most demands the same clarity a good homepage needs. Gaps in the summary often point to gaps on the site.

Because adoption is uncertain, it should sit on top of the basics: accessible pages, clear content, structured data and one consistent description of the company across the web.

How we approach it

An llms.txt file can be added to Framer and Webflow sites. Webflow takes an uploaded file in its SEO settings, and Framer supports llms.txt too, alongside Markdown versions of pages for AI agents. The summary it needs is the same one positioning and messaging work produces. It says what the company does, for whom and where to learn more.

FAQ

robots.txt tells crawlers which parts of a site they may access. llms.txt suggests which content is most useful to read, and it has no effect on access.

If it’s quick on your platform, yes. It costs little and may help some AI tools. Keep the main effort on clear pages.

A one-paragraph description of the company and product, then links to your most important pages, such as product, pricing, documentation and key guides, each with a one-line summary.

Show us what you’re working on

Book a call and walk us through what’s changing. We’ll suggest the scope that fits, or tell you if you don’t need us yet.

Tel Aviv
Your time