What is llms.txt?
It is a proposed file that gives AI tools a short guide to your website. The idea’s own site describes it as a proposal to standardise on an /llms.txt file to help agents use a website. It uses Markdown, a simple text format, and lists your key pages with short notes. Think of it as a friendly index for AI assistants. It is not a rule that any search engine has to follow.
What does Google say?
That you do not need it for Google. Google’s guide to AI features says there are no additional requirements to appear in AI Overviews or AI Mode. It says you do not need to create new machine-readable files, AI text files or markup to appear in these features. Google’s advice is the familiar list. Allow crawling, link your pages, keep key content in text and make structured data match the page.
How does it compare with files you already have?
| File | What it does | Needed? |
|---|---|---|
| robots.txt | Tells crawlers what they may visit | Yes |
| sitemap.xml | Lists pages for search engines | Yes |
| Product structured data | Labels name, price and stock | Yes |
| llms.txt | A summary for AI assistants | Optional |
What should you fix first?
- Check robots.txt allows search crawlers, including AI search crawlers you want.
- Make sure your sitemap lists your products, collections and key pages.
- Write product pages that state the item, specs and price plainly.
- Keep structured data matching the visible page.
- Only then consider an llms.txt file.
If you do add one, what goes in it?
Keep it short and true. A title with your store name, one line on what you sell, then links to your main collections, your policies and your About page, each with a short note. For example: “Handloom cotton sarees from Bengal, shipped across India.” Update it when you add a collection or change a policy. An out-of-date llms.txt misleads the very tools it is meant to help.
Is it worth the time for a small store?
Probably not yet. It does no harm, and a short file takes an hour. But the same hour spent rewriting your five best product pages will help buyers, Google and AI tools more. Treat llms.txt as a small extra once the basics are solid. Watch whether major AI tools start relying on it, and revisit then.
What do AI search crawlers actually need?
Access and clear pages. OpenAI, for example, documents a search crawler that sites can allow in robots.txt. If your robots.txt blocks such crawlers by accident, no llms.txt will help. So the real work is the same as for search: let the right crawlers in, and make every important page clear enough to quote.
Who is using llms.txt?
Mostly documentation sites and some online businesses testing it. Support among AI tools is uneven, and the proposal may change. That is another reason to treat it as an extra. If you add one, note the date, and check every few months whether the tools you care about actually read it.
Your store’s basics on The Storemate
On The Storemate, your robots.txt is editable under SEO, then Technical, and the default rules do not block AI search crawlers. Your sitemap lists your products, collections, pages and blog posts, and product pages carry structured data built from the product.