Guides
How AI crawlers reach a site, why a reachable site may still not be cited, and how to measure the difference. Each guide links its primary sources and says what it cannot prove.
Why isn’t my website cited by ChatGPT or other AI search engines?
A stage-by-stage diagnosis — fetch, index, retrieve, select, cite — of why an AI assistant does not cite a page, with what you can check yourself and what no scan can tell you.
Reviewed 26 October 2026
How to verify AI search crawler access to your website
Check robots.txt, HTTP status, noindex and snippet controls, CDN and firewall rules, and server logs for OAI-SearchBot, Claude-SearchBot, PerplexityBot and other AI crawlers.
Reviewed 26 October 2026
AI crawler audit vs. AI citation tracking: what each can and cannot tell you
What a technical crawler-access audit measures, what citation monitoring measures, and why neither one alone tells you whether AI search will cite your site.
Reviewed 26 October 2026