You may have seen mentions of a file called llms.txt and wondered whether your business website needs one. The honest answer depends entirely on what kind of website you run.
Short answer: llms.txt is a Markdown file you place in your website's root directory to help AI models understand your content. It was proposed in September 2024, and over 844,000 websites have adopted it (BuiltWith). For most small business websites, it will not change your rankings. For content-heavy or documentation sites, it is worth the 10 minutes it takes to create.
What llms.txt Actually Is
llms.txt was proposed by Jeremy Howard, co-founder of Answer.AI and creator of the fast.ai deep learning course, in September 2024. The specification lives at llmstxt.org.
Think of it as robots.txt for AI. While robots.txt tells search engine crawlers which pages to index, llms.txt tells large language models which pages are most important and what your site is about. The file is written in Markdown and includes a title describing your business, section headings grouping related content, links to key pages with short descriptions, and optionally a companion llms-full.txt file with the complete page content.
When an AI model encounters your site, this file provides a structured summary instead of forcing it to parse every page independently.
Who Is Actually Using It
The adopters are overwhelmingly tech and documentation sites. Anthropic, Cloudflare, Stripe, Zapier, and Supabase all maintain llms.txt files. Anthropic's version is 8,364 tokens long with a companion full file of over 481,000 tokens (Mintlify's analysis).
Tools like GitBook, Mintlify, and Yoast SEO have added automatic llms.txt generation. As of late 2025, BuiltWith tracked over 844,000 sites with the file implemented.
The Honest Take on Whether It Works
Google's John Mueller has called llms.txt "unnecessary." Search Engine Journal reported that no AI platform has officially adopted it as part of their ranking or citation system. Squirrly, an SEO tool that added llms.txt support, stated publicly that there is "currently zero proof that it helps with being promoted by AI search engines."
On the other hand, Microsoft, OpenAI, and other AI companies are actively crawling and indexing these files (Mintlify's research). The standard is gaining adoption even if its direct impact remains unproven.
The balanced view: llms.txt costs nothing and takes about 10 minutes to create. If it eventually becomes a standard that AI models rely on, early adopters benefit. If it does not, you have lost 10 minutes.
Should Your Business Create One?
Yes, if you run a content-heavy site, publish documentation, maintain a blog with dozens of articles, or offer multiple services across many pages. The file helps AI models quickly understand your site structure.
Probably not a priority if you run a simple five-page business site. AI models can already understand sites that small. Your time is better spent on Google Business Profile optimization, content quality, and reviews.
The middle ground: If your site has 20 or more pages, spend 10 minutes creating a basic llms.txt listing your most important pages with one-line descriptions. Low effort, optionality upside.
What This Means for Your Business
AI search is growing fast, and the standards AI uses to understand websites are still evolving. llms.txt is not a ranking factor today, but the landscape is shifting quickly. If you want to be positioned early without spending real money, creating the file is a reasonable bet. Just do not expect it to replace actual SEO work.
Related reads:
- How Does ChatGPT Choose Which Businesses to Recommend?
- How to Get Cited in Perplexity AI
- Our Generative Engine Optimization Services
Want help getting your business found in AI search results? We specialize in Generative Engine Optimization, helping businesses get cited in ChatGPT, Perplexity, and Google AI Overviews. Talk to our team →
