Guides to AI search visibility
What actually affects whether AI assistants can read and quote your site, with the sources behind every claim.
November 18, 2026, 6 min read
Can AI crawlers see JavaScript sites? How to test and fix it
GPTBot, ClaudeBot and PerplexityBot didn't run JavaScript in Vercel's 2024 data. How to see what a non-JS crawler sees, then fix with SSR or prerendering.
Read the guideNovember 18, 2026, 6 min read
Can ChatGPT crawl my website? How to check OpenAI's 3 bots
Check if ChatGPT can crawl and cite your site: OAI-SearchBot vs GPTBot vs ChatGPT-User, robots.txt rules, Cloudflare blocks and a curl test you can run.
November 18, 2026, 6 min read
Does llms.txt work in 2026? What the studies and Google say
Ahrefs found 97% of llms.txt files got zero requests in May 2026, and SISTRIX saw no citation effect. Here is the evidence and what to fix first instead.
November 18, 2026, 6 min read
How to block AI training on Cloudflare and stay in AI search
Set Cloudflare's Training control to Disallow AI Training, not Block. Block now also stops Googlebot, Bingbot and Applebot. A setup for B2B sites.
November 18, 2026, 6 min read
How to write answer-first pages that AI assistants can quote
Write page openings AI assistants can quote: state the question, answer it in sentence one, add real specifics. Evidence, a before/after and a checklist.
November 18, 2026, 6 min read
OAI-SearchBot vs GPTBot vs ChatGPT-User: which should you allow?
OpenAI runs three crawlers. Allow OAI-SearchBot to appear in ChatGPT search, block GPTBot to opt out of training. Exact robots.txt lines for each bot.