Make Your Website Easy for AI to Read
AI can only repeat what it can read. Here is what Google, OpenAI and others say their systems need from a small business website, and what you can skip.
Part 2 of the series Is Your Business Ready for AI?
When someone asks ChatGPT or Google's AI Mode for "a plumber near me who does tankless water heaters," the answer gets assembled from pages those systems were able to read. If your site says it clearly, in text, on a page a crawler is allowed to open, you are in the running. If the same fact lives in a photo of a flyer, or behind a setting that blocks AI crawlers, you are not.
The good news is that the companies building these tools have written down what they need. Most of it is ordinary, and none of it requires buying a special "AI SEO" package.
Start with what Google actually says
Google's guidance for site owners is blunt: "There are no additional requirements to appear in AI Overviews or AI Mode, nor other special optimizations necessary." It adds that you do not need "new machine readable files, AI text files, or markup," and that there is "no special schema.org structured data that you need to add."
What Google does ask for is the basics. To show up as a supporting link in its AI features, a page has to be indexed and eligible to appear in regular Google Search. Its list of things still worth doing includes:
- Making sure crawling is allowed in your robots.txt file "and by any CDN or hosting infrastructure"
- Making sure "important content is available in textual form"
- Making sure your structured data "matches the visible text on the page"
- Keeping your Business Profile information up to date
Google also says none of this is a guarantee. Meeting every requirement does not mean it will crawl, index or show your page.
So the work is not exotic. It is five plain checks.
1. Make sure you are not blocking the readers
A robots.txt file is a small text file on your site that, in Google's words, "tells search engine crawlers which URLs the crawler can access." You can see yours by typing your web address followed by /robots.txt.
AI companies use separate crawlers for separate jobs, and you can allow one without the other:
- OpenAI uses OAI-SearchBot for ChatGPT's search features and GPTBot for collecting content that may be used to train its models. OpenAI says sites that opt out of OAI-SearchBot "will not be shown in ChatGPT search answers," though they can still appear as plain navigational links. Each setting is independent, so you can allow search and decline training.
- Anthropic (Claude) lists three: ClaudeBot for training, Claude-SearchBot for search, and Claude-User for when a person asks Claude to look at a page.
- Perplexity uses PerplexityBot to surface and link sites in its results, and says that bot "is not used to crawl content for AI foundation models."
- Google has a token called Google-Extended that controls whether your content is used for training Gemini models and for grounding in Gemini apps. Google says Google-Extended "does not impact a site's inclusion in Google Search."
The practical point: some site builders, security plugins and hosting services have an AI crawler switch of their own, separate from robots.txt. Cloudflare, for example, has a setting called "AI Crawler and Agent access policies" under Security settings. Defaults vary by provider and can change, so look instead of assuming. If you want to be found in AI search, the search crawlers need to be allowed. Whether you also allow training crawlers is a separate business decision, and either answer is reasonable.
If you do not manage your own site, send your web person one question: "Are we blocking OAI-SearchBot, Claude-SearchBot, PerplexityBot or Googlebot anywhere, in robots.txt or at the host?"
2. Put the important facts in real text
This is my advice, built on Google's "textual form" line. For each thing you want to be found for, there should be words on a page that say it:
- A page for each main service, saying what it is, who it is for and where you do it
- Your service area or locations named in text, not only shown on a map image
- Hours, phone number and address as text, not baked into a graphic
- Prices or price ranges if you are comfortable publishing them
A menu that exists only as a PDF scan or a photo is the classic miss. Put the items on the page too.
3. Keep your name, address and phone identical
Google's Business Profile guidelines say your name should reflect your real-world name "as used consistently on your storefront, website, stationery, and as known to customers." Take that literally. Pick one exact version of your business name, address and phone number and use it on your website, your Google profile and everywhere else. "Smith Heating & Air" on one and "Smith HVAC LLC" on another makes you look like two businesses. Part 5 of this series covers the listings side.
4. Add structured data for your business
Structured data is a bit of code in your page that labels facts for machines. Google calls it "a standardized format for providing information about a page." For a local business, Google's documentation describes a type called LocalBusiness that lets you state things like your business hours in a way Google can read directly. It recommends a format called JSON-LD in most cases.
Two cautions. Structured data has to match what a visitor can see on the page. And remember Google's own statement that no special markup is required for its AI features. Structured data is good housekeeping that removes guesswork. It is not a ranking trick.
Most modern site builders and SEO plugins can add LocalBusiness data for you. Google's Rich Results Test will check a page and tell you what it found.
5. Write FAQs for people, not for a search feature
FAQ sections are useful because they answer real questions in plain text, which is exactly what an AI system can quote. Write the questions customers actually ask you on the phone.
Do not expect a special Google display for it, though. Google retired its FAQ rich result this year. Its changelog says the feature "will no longer appear in Google Search starting May 7, 2026," and the documentation was removed in June. If someone is selling you FAQ markup as a way to get a bigger Google listing, that information is out of date.
What about llms.txt?
You may hear that you need a file called llms.txt. Here is its honest status as of November 2026.
It is a proposal, first published in September 2024 by Jeremy Howard, for a text file that helps AI agents use a website. Its own site still describes it as a proposal that is "open for community input."
Google's position is in writing: creating one "will neither harm nor help your site's visibility or rankings in Google Search, as Google Search ignores them." The crawler documentation I read from OpenAI and Anthropic describes robots.txt controls and does not mention llms.txt at all.
My take: it will not hurt you, and it may be useful for sites with heavy technical documentation. For a local business, it is not where I would spend the first hour or the first dollar.
How to tell if it is working
- Google Search Console shows whether your pages are indexed.
- Bing Webmaster Tools added an AI Performance report in public preview in February 2026. Microsoft says it shows how often your site is cited as a source in AI-generated answers.
- Ask the assistants. Search for your own services in ChatGPT and Google's AI Mode the way a customer would. Note what they get wrong, then go fix that fact on your site.
The short version
- Check that you are not blocking AI search crawlers, in robots.txt or at your host.
- Put services, locations, hours and contact details in real text.
- Use one exact name, address and phone everywhere.
- Add LocalBusiness structured data and test it.
- Write FAQs for humans. Skip the gimmicks.
Next in the series: Reviews are what AI recommends from. Or go back to the full checklist.
If you want help checking your own site against this list, get in touch.
Sources
- Google Search Central, "AI features and your website": https://developers.google.com/search/docs/appearance/ai-features
- Google Search Central, guide to optimizing for generative AI features (announced May 15, 2026): https://developers.google.com/search/docs/fundamentals/ai-optimization-guide
- Google Search Central documentation changelog (FAQ rich result entries May 8 and June 15, 2026; llms.txt entry June 15, 2026): https://developers.google.com/search/updates
- Google, "Intro to structured data": https://developers.google.com/search/docs/appearance/structured-data/intro-structured-data
- Google, "Local business structured data": https://developers.google.com/search/docs/appearance/structured-data/local-business
- Google, "Introduction to robots.txt": https://developers.google.com/search/docs/crawling-indexing/robots/intro
- Google, common crawlers (Google-Extended): https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
- OpenAI, "Overview of OpenAI Crawlers": https://developers.openai.com/api/docs/bots
- Anthropic, crawler help article: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- Perplexity, crawler documentation: https://docs.perplexity.ai/guides/bots
- Cloudflare, "AI Crawler and Agent access policies" (last updated November 2, 2026): https://developers.cloudflare.com/bots/additional-configurations/block-ai-bots/
- llmstxt.org (published September 3, 2024): https://llmstxt.org/
- Bing Webmaster Blog, AI Performance public preview, February 10, 2026: https://blogs.bing.com/webmaster/February-2026/Introducing-AI-Performance-in-Bing-Webmaster-Tools-Public-Preview
- Google Business Profile guidelines: https://support.google.com/business/answer/3038177