Skip to main content
Back to Intelligence Journal
SEO

Do You Need an llms.txt File in 2027? What Actually Gets Your Brand Cited by AI

• Updated • 6 min read
Do You Need an llms.txt File in 2027? What Actually Gets Your Brand Cited by AI

Quick answer: For most businesses, no. Google says it does not use llms.txt for Search, and large studies have found no measurable link between having the file and being cited by AI tools. Create one only if you run documentation or developer content. What does help: letting AI crawlers in, publishing pages worth quoting, and being mentioned by other trusted sites.

What is llms.txt, and why did everyone start adding it?

llms.txt is a plain Markdown file placed at yoursite.com/llms.txt. It lists your most useful pages with short descriptions, so a language model can find the good material quickly. The idea was proposed in 2024 and spread fast because it sounded like “robots.txt for the AI era.”

It is not. robots.txt controls what crawlers may access, and major crawlers follow it. llms.txt is only a suggestion, and nobody is obliged to read it.

Adoption ran far ahead of evidence. Ahrefs found that 28% of the 137,210 domains in its dataset publish a file, though its customers skew technical, so the real web figure is lower. SE Ranking found about 10% across roughly 300,000 domains.

What does Google say about llms.txt?

Google’s official guide to generative AI features says Google Search does not use llms.txt. You can skip it, and creating one will neither help nor hurt your Google visibility. That matches the wider point we made in What Is GEO in 2027?: for Google’s AI Overviews and AI Mode, the basics of SEO still apply.

What does the data say about llms.txt and AI citations?

StudySizeWhat it found
SE Ranking (Nov 2025)About 300,000 domainsNo clear link between having the file and AI citation frequency. Removing it from their model improved accuracy.
Ahrefs (May 2026 server logs)137,210 domains97% of valid files got zero requests. Retrieval bots tied to ChatGPT and Perplexity were about 1% of requests. No AI bot asked for the file on sites that did not have one.
Trakkr, summarised by Pixis37,894 domainsNo statistically significant citation advantage (p-value 0.83).

Be fair to the file, though. Ahrefs measured requests, not citations, and says so. SE Ranking’s work is correlation, not a controlled test. So the honest conclusion is “not shown to help,” not “proven useless.” AI platforms can change, and you should re-check in 2027.

Who might still want an llms.txt?

The few real readers in Ahrefs’ data skewed towards coding agents. If you run API documentation, developer guides or a SaaS help centre that people feed into AI coding tools, a clean llms.txt is a cheap convenience. Just do not expect it to win you citations.

Should you create one? A quick guide by business type

Business typeOur view
Local service (clinic, salon, plumber, coaching)Skip. Spend the time on your Google Business Profile and reviews.
E-commerce and D2CSkip. Fix product data, reviews and category pages first.
B2B SaaS with public docsOptional and low effort. Worth 30 minutes.
Agency or consultancyOptional. Low priority.
Publisher or news siteSkip for citations. Decide your AI crawler rules in robots.txt instead.

How do you create an llms.txt file in 30 minutes?

If you decide to, keep it short and accurate:

# Example Co
> Example Co is a Delhi-based accounting software company. This file lists our most useful public pages.

## Docs
- [Getting started](https://example.com/docs/start): set up in 10 minutes
- [Pricing](https://example.com/pricing): plans in INR

## Guides
- [GST invoicing guide](https://example.com/guides/gst-invoicing): how to create compliant invoices

Rules to follow:

  • List only live, public pages that match what visitors see.
  • Update it when pages move or disappear.
  • Never use it as access control. Use robots.txt for that.
  • Do not expect it to be quoted or ranked.

What actually gets your brand cited by AI? 5 things that matter more

1. Let the right crawlers in. This is the most overlooked fix. OpenAI uses separate bots: OAI-SearchBot for ChatGPT search, GPTBot for training and ChatGPT-User for actions a person starts. OpenAI’s documentation says sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, and recommends allowing it in robots.txt and allowing its published IP ranges. Changes can take about 24 hours to apply. A typical setup for a business that wants visibility but not training use looks like this:

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: GPTBot
Disallow: /

Whether to block training is a business decision, and each bot is set independently. Also test your CDN, firewall and security plugins, because some block AI bots by default. Check each AI company’s own crawler page, as names and rules change.

2. Publish pages worth quoting. Original data, clear answers near the top, named authors and sources. Generic, copied advice gives an AI tool no reason to pick you. Our GEO guide and Answer Engine Optimization playbook show how to structure these pages.

3. Get mentioned by other trusted sites. This is where the strongest evidence points. In Ahrefs’ study of 75,000 brands, branded web mentions correlated with visibility in Google AI Overviews at 0.664, against 0.218 for backlinks. A Muck Rack analysis of more than 25 million links cited by ChatGPT, Claude and Gemini found that earned media made up most of them, with paid and advertorial content a tiny share. Both are observational and partly vendor-run, so they show a pattern, not a guarantee. The takeaway is still sensible: be worth writing about. We covered this shift in SEO Didn’t Die in 2026, It Became Digital PR. Skip fake mentions, which carry the same risk we described in What Is Parasite SEO?

4. Make your business easy to identify. Use the same name, address and phone number everywhere, a real About page, author pages and a complete Business Profile. Our Local SEO services start here.

5. Fix the basics. Pages must be indexable, fast and free of duplicates. A technical audit under our SEO services catches what blocks both Google and AI crawlers.

What does this mean for Indian businesses?

Third-party mentions are where many Indian small businesses can move fastest, because the sources are close to home:

  • Industry directories and marketplaces such as Justdial, Sulekha and IndiaMART, where relevant, with accurate details.
  • Trade publications, local news, industry associations and podcasts.
  • Genuine customer reviews and a consistent LinkedIn presence for B2B.

If you want industry-specific ideas, start with SaaS, legal, D2C or real estate. For Delhi NCR, see our AI SEO expert in Delhi and SEO in Noida pages.

A 30-day plan to get cited without llms.txt

WeekFocusOutput
1AccessCheck robots.txt, CDN and firewall for AI crawler blocks. Confirm key pages are indexed.
2PagesUpdate your top 5 service pages with direct answers, original facts and named sources.
3MentionsAsk 15 customer questions in ChatGPT, Perplexity and Google AI Mode. List which sites get cited, then pick 10 you could realistically appear on.
4Outreach and trackingPitch an expert quote, case study or data point to those sites. Re-run the prompts and log changes.

Our free SEO tools list and ZestSmartTools can help with the checks.

What mistakes should you avoid?

  • Paying for “AI optimization” that is only an llms.txt file.
  • Blocking OAI-SearchBot by accident, then wondering why ChatGPT never mentions you.
  • Buying mentions or publishing paid posts disguised as editorial.
  • Listing outdated or private pages in llms.txt.
  • Treating one AI answer as proof. Answers change between runs, so look at trends over weeks.

So, do you need llms.txt in 2027?

Probably not. If you have docs, add one in half an hour and move on. Put your real effort into crawler access, quotable pages and earning mentions. If you want a hand, our AI Search Optimization service and AI SEO services guide for India explain what we do, or you can contact our team.

Frequently Asked Questions About llms.txt

Do I need an llms.txt file in 2027?
Most businesses do not. Google says it does not use the file, and large studies show no measurable citation benefit. It is optional for documentation-heavy or developer-focused sites.

Does llms.txt help SEO?
No. Google Search does not use it, and creating one will not help or hurt your rankings. Spend the time on content quality, crawlability and genuine third-party mentions.

Does ChatGPT read llms.txt?
OpenAI’s crawler documentation focuses on robots.txt and does not say llms.txt affects search. In Ahrefs’ data, bots tied to ChatGPT and Perplexity made up about 1% of requests for the file.

What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may access, and major crawlers respect it. llms.txt is an optional list of suggested pages. It cannot block or allow anything.

Can llms.txt hurt my website?
Unlikely, and Google says it will not. The risk is upkeep: outdated links or pages that do not match your public site make it inaccurate. Keep it short and current.

How do I create an llms.txt file?
Create a Markdown file named llms.txt in your site root with your name, a one-line summary and links to your most useful public pages, each with a short description. Check that it loads.

How do I get my brand cited by AI search?
Allow search crawlers such as OAI-SearchBot, publish original and sourced pages, keep business details consistent and earn mentions from trusted sites. No tactic guarantees citations, so track results monthly.

Should I block GPTBot or other AI crawlers?
It depends. GPTBot relates to model training and OAI-SearchBot to ChatGPT search, and each is set separately. Blocking OAI-SearchBot means you will not be shown in ChatGPT search answers.

Do brand mentions matter more than backlinks for AI?
In Ahrefs’ 75,000-brand study, branded web mentions correlated more strongly with AI Overview visibility than backlinks did (0.664 vs 0.218). It is correlation, not proof, but it supports earning real mentions.

Sources and Further Reading

  1. Google Search Central, Optimizing your website for generative AI features on Google Search
  2. Ahrefs, We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read (15 June 2026)
  3. Search Engine Journal, LLMs.txt Shows No Clear Effect On AI Citations, Based On 300k Domains
  4. Pixis, Does llms.txt Help AI Citations? What the Evidence Actually Shows
  5. OpenAI, Overview of OpenAI Crawlers
  6. Ahrefs, AI Overview brand visibility correlation study
  7. MarTech, AI visibility depends on who writes about your brand (Muck Rack data)
  8. llmstxt.org, the original proposal
★

Follow ZestRank on Google

Add ZestRank as your preferred source to see our latest SEO & AI search updates first in Google Search.

Done-For-You Execution

Want Us to Fix This for You?

If your website is losing traffic, experiencing ranking drops, or burning budget without enquiries, let ZestRank diagnose and fix the issue.

Tags: #llms.txt 2027
Rohit Nandan - ZestRank Founder & Lead Digital Marketing Consultant

About the Author:

Founder & Lead Digital Marketing Consultant

Rohit Nandan is ZestRank's Founder & Lead Digital Marketing Consultant and YouTube SEO Expert, with over 15 years of experience diagnosing and running search campaigns for businesses across Delhi NCR. He personally reviews ZestRank's client projects, with deep expertise in technical SEO infrastructure and YouTube optimization. Have a question about this post? Message Rohit directly on WhatsApp.

Follow ZestRank: Facebook · LinkedIn · Instagram · X

Free Consultation

Delhi NCR

Ready to find out why your website or local listings are losing leads? Get a free search audit from our team.

Recommended Hosting Up to 75% Off
Hostinger High-Performance WordPress & Cloud Hosting Deal
Activate Offer →
  • Ultra-fast NVMe storage & LiteSpeed cache
  • Free domain, SSL & daily backups
  • Extra 10% off coupon: 1ROHIT89
Claim Hostinger Deal

Starts at ₹139/mo* • 30-day money-back guarantee