Guides to AI search visibility

What actually affects whether AI assistants can read and quote your site, with the sources behind every claim.

November 18, 2026, 6 min read

Can AI crawlers see JavaScript sites? How to test and fix it

GPTBot, ClaudeBot and PerplexityBot didn't run JavaScript in Vercel's 2024 data. How to see what a non-JS crawler sees, then fix with SSR or prerendering.

Read the guide

November 18, 2026, 6 min read

Can ChatGPT crawl my website? How to check OpenAI's 3 bots

Check if ChatGPT can crawl and cite your site: OAI-SearchBot vs GPTBot vs ChatGPT-User, robots.txt rules, Cloudflare blocks and a curl test you can run.

November 18, 2026, 6 min read

Does llms.txt work in 2026? What the studies and Google say

Ahrefs found 97% of llms.txt files got zero requests in May 2026, and SISTRIX saw no citation effect. Here is the evidence and what to fix first instead.

November 18, 2026, 6 min read

How to block AI training on Cloudflare and stay in AI search

Set Cloudflare's Training control to Disallow AI Training, not Block. Block now also stops Googlebot, Bingbot and Applebot. A setup for B2B sites.

November 18, 2026, 6 min read

How to write answer-first pages that AI assistants can quote

Write page openings AI assistants can quote: state the question, answer it in sentence one, add real specifics. Evidence, a before/after and a checklist.

November 18, 2026, 6 min read

OAI-SearchBot vs GPTBot vs ChatGPT-User: which should you allow?

OpenAI runs three crawlers. Allow OAI-SearchBot to appear in ChatGPT search, block GPTBot to opt out of training. Exact robots.txt lines for each bot.