llms.txt: Does It Help? An Honest Look

By Om Usturge · Updated October 31, 2026 · 3 min read

Short answer: llms.txt is a proposed plain-text file that gives AI tools a short, curated map of your site. It's cheap to make, but Google has stated it does not affect Search or AI features, and no major provider has committed to using it for ranking or citations. Create one if you like, but don't expect results, and fix the basics first.

What it is

The idea was proposed in 2024 as a markdown file at /llms.txt that points language models to your most useful pages with short descriptions. Think of it as a hand-written table of contents for machines, unlike robots.txt, which says what to crawl, or the sitemap, which lists every URL.

What we know and what we don't

Known:

  • It's a proposal and community convention, not an internet standard.
  • It's easy to create and harmless.
  • Some documentation sites and developer tools publish one. Anthropic publishes one for its own docs. Adoption among the top 1,000 domains was measured at 9.3% in September 2026, up from 0.3% in June 2025.

Not established:

  • Google's position is explicit and current: "It's completely fine if you decide to create and maintain LLMS.txt files… will neither harm nor help your site's visibility or rankings in Google Search, as Google Search ignores them" (developers.google.com/search/docs/fundamentals/ai-optimization-guide). Google's search team has also said on Bluesky that adding llms.txt to its own developer docs was not an official endorsement, and the file was later removed from those docs.
  • Whether other engines use it for ranking or citations. Perplexity and some AI agents read it in certain configurations, but no major provider has committed to using it for answer generation. OpenAI's crawler documentation recommends robots.txt and never references llms.txt.
  • The evidence from server-log studies: one 90-day experiment found that of 62,100+ AI bot requests, just 84 (~0.1%) touched /llms.txt. Matched-pair citation studies find no measurable difference between adopters and non-adopters.

If someone sells it as a guaranteed GEO win, ask for the evidence.

How to create one in 15 minutes

Create https://wizetool.com/llms.txt:

> Free SEO and GEO tools and plain-English guides. No sign-up.

## Tools
- [SEO Optimizer](https://wizetool.com/tools/seo-optimizer/): checks a page for on-page and technical issues
- [GEO Optimizer](https://wizetool.com/tools/geo-optimizer/): checks how ready content is for AI search
- [Dead Link Checker](https://wizetool.com/tools/dead-link-checker/): finds broken links and redirects

## Guides
- [On-page SEO checklist](https://wizetool.com/guides/on-page-seo-checklist/): practical checks for any page
- [GEO vs SEO](https://wizetool.com/guides/geo-vs-seo/): what changes and what stays the same

Rules: plain markdown, a title, a one-line summary, then short link lists. Keep it small. Only list pages you're proud of.

A fair way to test it

  1. Write down your current citations using the manual method.
  2. Publish the file.
  3. Re-test after 8 weeks, changing nothing else.
  4. Report what you saw, including "no change".

One test on one site proves little, but honest notes help others.

What to do first instead

Quick checklist

  • Understand it's unproven for search visibility
  • Core SEO and GEO basics done
  • File is short, accurate and uses real URLs
  • Added to your documentation, not sold as magic
  • Re-test scheduled

FAQ

Can llms.txt hurt? It's unlikely to, if the URLs are correct and public.

Is it the same as llms-full.txt? Some sites publish a longer variant with full text. It's optional and adds maintenance.

Does Google use it? No. Google has stated that it ignores llms.txt and that it neither helps nor hurts Search visibility. Check Google's AI optimization guide for the current wording.

Sources

Related guides