If your website does not show up in ChatGPT or AI search, the cause is almost always one of seven things: blocked AI crawlers, a missing Bing index, no schema markup, weak entity signals, thin content, inconsistent business details, or a Cloudflare bot filter you never knew was on. Most are fixable in an afternoon, and a site can be invisible to AI even while it ranks fine on Google. This guide diagnoses each cause and gives the fix.
Are AI crawlers blocked in your robots.txt?
Check robots.txt first, because a single line can make your site invisible to ChatGPT. Open yoursite.com/robots.txt and look for any rule that disallows GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot, or Google-Extended. A block like “User-agent: GPTBot” followed by “Disallow: /” hides you from that engine completely.
This is the most common and most easily fixed reason, per multiple 2026 troubleshooting guides. The fix is to allow the AI crawlers you want: remove the disallow rules, or explicitly add “User-agent: GPTBot” with “Allow: /”. Note the distinction between training crawlers and search crawlers. GPTBot covers OpenAI broadly, while OAI-SearchBot fetches pages for ChatGPT’s live search results, so blocking the wrong one can keep you out of citations even if you meant only to opt out of model training. List each engine’s bot deliberately rather than blocking with a blanket rule. After editing, re-test the file before assuming it is fixed.
Is your site even in Bing’s index?
If ChatGPT and Copilot cannot find you, check Bing, not Google. ChatGPT’s live search and Microsoft Copilot both run on the Bing index, so if Bing has not indexed your pages, those engines cannot cite you no matter how well you rank on Google. This trips up sites that optimized for Google for years and never looked at Bing.
Sign up for Bing Webmaster Tools, submit your sitemap, and confirm your key pages are indexed. Bing also added AI performance reporting, which shows how your pages surface in AI answers, so the same free tool diagnoses the problem and tracks the fix. Because Bing powers two of the largest AI surfaces, getting indexed there is one of the highest-impact moves a previously invisible site can make. Treat Bing Webmaster Tools as a required setup step, not an optional one, and you close a gap most competitors leave open. We cover the broader measurement setup in how to track your AI search visibility.
Is Cloudflare or your host silently blocking AI bots?
Yes, this happens constantly, and it is invisible from inside your CMS. Cloudflare’s Bot Fight Mode and its “AI Scrapers and Crawlers” setting block GPTBot, ClaudeBot, PerplexityBot, and similar crawlers, and these settings are enabled by default on millions of sites. Your robots.txt can say “Allow,” but the edge network blocks the bot before it ever reads the file.
Check your Cloudflare dashboard under bot management and your hosting provider’s security settings for any AI-crawler or scraper-blocking rule. Many site owners turned these on for good reasons, to stop scraping, then never connected the dots when AI citations dried up. If you want AI engines to see and cite you, you have to allowlist their crawlers at the edge as well as in robots.txt. This two-layer block is the reason a technically perfect robots.txt sometimes changes nothing. Verify both layers before you conclude the problem is elsewhere.
Does your content give AI engines something to extract?
If your pages are thin or vague, AI engines have nothing clean to pull. Engines cite passages that answer a question directly. Marketing copy that talks around the topic, buries the answer, or never states a clear fact gives them nothing to lift, so you stay out of answers even when the crawler can reach you.
The fix is structural. Lead each page with a direct answer to the question it targets, use H2 headings phrased as questions, and answer each one in the first 40 words underneath. Add original data, specific numbers, and named examples, because engines prefer to cite a source for a concrete fact. FAQ sections and tables get pulled at high rates, so add both where they fit. Missing schema compounds the problem: without FAQPage, Article, or Organization markup, the engine has to guess what each passage is. Thin content plus no schema is the most common reason a crawlable site still does not get cited. We cover the content fixes in how to get cited by ChatGPT.
Are your entity signals and business details strong enough?
If AI engines cannot confirm who you are, they will not recommend you. Entity signals are the third-party proof of your existence and reputation: reviews, directory listings, consistent business details, and mentions on sites the engine already trusts. Weak signals leave the engine unsure you are real or relevant, so it cites a competitor it can verify.
Two fixes matter most. First, make your name, address, and phone identical everywhere they appear, because inconsistent details (St. versus Street, an old phone number, a former address) split your identity across the web and weaken trust. Second, build mentions on sources the engines lean on: Wikipedia where you qualify, industry directories, review platforms, and editorial coverage. AI engines cite a small set of sources heavily, so being present on those sources matters more than raw backlink count. This is slower than a robots.txt edit, but it is what moves you from “crawlable” to “recommended.” For the patterns engines reward, see what sources do AI engines cite.
How do you verify a fix actually worked?
Verify in layers, because each cause has its own test and “it looks fixed” is not the same as “the engine can see it.” Confirm crawler access, then index status, then actual citation, in that order, so you know exactly which fix moved the needle.
Start at the access layer: re-fetch your robots.txt and confirm the AI bots are allowed, then check your Cloudflare and host settings to be sure no edge rule still blocks them. Next, the index layer: in Bing Webmaster Tools, confirm your priority pages show as indexed and submit the sitemap if they do not, since Bing feeds ChatGPT and Copilot. Then the citation layer: ask the engines directly. Prompt ChatGPT, Perplexity, and Google’s AI with the buyer questions you want to win and see whether you appear, and use the AI performance report in Bing Webmaster Tools and a GA4 AI-referral segment to confirm real visits. Give each fix time before you judge it, because engines re-crawl on their own schedule and citations can lag the fix by weeks, faster on Perplexity, slower on ChatGPT. Working the layers in order keeps you from declaring victory at the robots.txt stage while a Cloudflare rule still blocks every bot.
Frequently asked questions
How do I check if ChatGPT can see my website? Open yoursite.com/robots.txt and confirm GPTBot and OAI-SearchBot are not disallowed, then verify your pages are indexed in Bing Webmaster Tools, since ChatGPT search runs on Bing. Also check Cloudflare or your host for AI-crawler blocking.
Why does my site rank on Google but not appear in ChatGPT? Because ChatGPT uses the Bing index, not Google’s. A site can rank well on Google while being unindexed or blocked on Bing, which keeps it out of ChatGPT and Copilot answers. Submit your sitemap to Bing to fix it.
Does blocking GPTBot hurt my AI visibility? Yes, if you block the search crawler. GPTBot covers OpenAI broadly and OAI-SearchBot fetches pages for live ChatGPT search. Blocking the search crawler keeps you out of citations even when your content is strong.
How long until my site appears in AI search after I fix the blocks? There is no fixed timeline. Once crawlers can reach you and Bing indexes your pages, citations can appear within weeks, faster on Perplexity, slower on ChatGPT, as engines re-crawl and rerank. Freshness and strong structure speed it up.
Do I need an llms.txt file to show up in AI search? No. An llms.txt file does not control whether AI engines can crawl or cite you, that is robots.txt, your index status, and your content. llms.txt is optional and adoption is limited, so fix the seven core issues first.
Get found by the engines
Most AI invisibility traces to access and structure, not luck. Work the list in order: unblock crawlers in robots.txt, get indexed in Bing, clear any Cloudflare bot filter, then strengthen content, schema, and entity signals. Each fix is concrete and most sites have at least two of these problems live right now. For the full optimization framework, read AI search optimization: the complete 2026 guide. To get a diagnosis of your own site, run our free GSC analysis or book a call.
Sources: SearchScore: Why Your Website Isn’t Showing Up in ChatGPT, SEO Circular: Why Is My Website Not Showing Up on ChatGPT, Optimum Web: Why ChatGPT Can’t See Your Website, Quattr: GPTBot & Robots.txt Setup, TryGEO: 5 Reasons Your Site Is Invisible on ChatGPT
Tagged