# AI Search Audit > See which AI crawlers your site allows and what its served HTML lets them read. A free, deterministic technical-readiness audit with evidence for every finding. Canonical site: https://www.aisearchaudit.pro ## Product facts - Checks: 31 deterministic, rule-based checks (10 scored, 17 advisory, 4 informational). - Score: a technical-readiness score across 6 equally weighted capabilities. It is null ("assessment incomplete") when a required observation is missing. - Crawlers tracked: 17 AI crawlers and fetchers, reported by purpose (search, training, user-triggered). - Pages per scan: the homepage plus up to four more, ranked from the sitemap and homepage links, plus robots.txt, sitemap.xml and llms.txt. - No LLM is involved in any finding or score. - AI Visibility (citation check): AI Visibility is in beta and not yet open to accounts. - Limits: A 100 does not measure access from AI vendors’ own IP addresses, content that only appears after JavaScript runs, citations, rankings or traffic. - The product does not guarantee AI rankings, citations or visibility. ## The 6 scored capabilities - **HTTPS page access** (CR-001, CR-002, SC-001): The page was served as HTML over HTTPS, without a redirect loop. Establishes that this scanner could read it; not that every crawler can. - **Indexable and quotable** (CR-005, CR-009): No noindex directive and no snippet control that would keep the page out of search results or AI answers that quote it. Assumes the audited page is meant to be public. - **Usable page title** (MD-001): The page declares a non-empty title. Length and wording are advice and are not scored. - **Canonical declarations are usable** (MD-003): Every declared canonical resolves to an HTTP(S) URL and they agree. Not applicable when none is declared — declaring one is optional. - **Answer-engine crawlers not refused** (CR-004, CR-008): robots.txt allows the crawlers AI assistants use to find and cite pages, and the homepage did not refuse their user agents. Access from the vendors’ own IP addresses is not measured. - **Content present without JavaScript** (CE-005): The served HTML is not an empty application shell. Crawlers that do not run JavaScript read only what is served. ## AI crawlers tracked (17) | Token | Vendor | Purpose | | --- | --- | --- | | GPTBot | OpenAI | model training | | OAI-SearchBot | OpenAI | search / citations | | ChatGPT-User | OpenAI | user-triggered fetch | | ClaudeBot | Anthropic | model training | | Claude-SearchBot | Anthropic | search / citations | | Claude-User | Anthropic | user-triggered fetch | | anthropic-ai | Anthropic | model training | | Google-Extended | Google | model training | | Googlebot | Google | search / citations | | PerplexityBot | Perplexity | search / citations | | Perplexity-User | Perplexity | user-triggered fetch | | bingbot | Microsoft | search / citations | | Applebot | Apple | search / citations | | Applebot-Extended | Apple | model training | | CCBot | Common Crawl | model training | | meta-externalagent | Meta | model training | | Bytespider | ByteDance | model training | Blocking a training crawler is an editorial choice and is not scored. Blocking a search crawler removes the site from that assistant's answers and is scored. ## Pricing ### Free — $0 See what AI systems can access, understand, and retrieve from your site — every finding, with the evidence behind it. - 1 project (archiving holds the slot for 30 days — restoring is free) - All 31 checks, with evidence & recommendations - AI crawler access matrix (17 bots) - Technical-readiness score across 6 capabilities - Up to 5 important pages per scan - Latest scan only in your history Anonymous visitors can run 3 scans a day; free accounts 5. ### AI Search Fixer — $29 one-time, lifetime access Fix the issues preventing AI systems from properly accessing, understanding, and retrieving your website. - 4 specialized AI skills - 2 AI remediation agents - Fix supported audit findings - Generate implementation changes - Review before applying - Re-scan and verify the result - Lifetime access Skills: AI Crawler, AI Content, Structured Data, AI Retrieval. Agents: Technical Fix Agent, AI Readiness Agent. ### Pro — $5/month or $50/year Keep watching a site after you have fixed it. - Scheduled weekly or monthly re-scans - Regression alerts by email - Full scan history - Unlimited projects Full details: https://www.aisearchaudit.pro/pricing ## Guides - [Why isn’t my website cited by ChatGPT or other AI search engines?](https://www.aisearchaudit.pro/guides/why-ai-search-does-not-cite-your-website): A stage-by-stage diagnosis — fetch, index, retrieve, select, cite — of why an AI assistant does not cite a page, with what you can check yourself and what no scan can tell you. - [How to verify AI search crawler access to your website](https://www.aisearchaudit.pro/guides/verify-ai-crawler-access): Check robots.txt, HTTP status, noindex and snippet controls, CDN and firewall rules, and server logs for OAI-SearchBot, Claude-SearchBot, PerplexityBot and other AI crawlers. - [AI crawler audit vs. AI citation tracking: what each can and cannot tell you](https://www.aisearchaudit.pro/guides/ai-crawler-audit-vs-ai-citation-tracking): What a technical crawler-access audit measures, what citation monitoring measures, and why neither one alone tells you whether AI search will cite your site. ## Frequently asked questions ### Does this help my site rank in ChatGPT? We will not promise that, because nobody controls what a model chooses to cite. What we can tell you is whether the technical barriers in your control are removed: whether the crawlers behind those assistants can reach your pages at all, and whether what they find is structured well enough to quote. That is a precondition for being cited, not a guarantee of it. ### What is the difference between training and citation crawlers? Training crawlers (GPTBot, ClaudeBot, CCBot, Google-Extended) collect content that may be used to train a model. Citation crawlers (OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot) fetch or index pages so an assistant can answer with them and link back. Blocking the first is a legitimate editorial choice with no effect on whether you get cited. Blocking the second removes you from that assistant entirely. Most tools lump them together; we report them separately and only score the ones that affect citations. ### How often are the AI guidelines updated? The validation rules track public guidance from OpenAI, Anthropic, Google, Microsoft, Apple and Perplexity. The crawler registry is a single versioned table, so when a vendor ships or renames a bot it is a one-line change rather than an engine rewrite. ### Can I integrate this into my CI/CD pipeline? Not yet. There is no public API and no CI/CD integration today — scans run from the web app against any public HTTPS URL. Both are planned, and this answer will change when they ship. ### Do I need to create an account to scan? No. You can scan any public website and get a full report without signing up — every check, every finding, and the evidence behind it. Findings that have a generated fix show that clearly, and AI Search Fixer ($29 lifetime) generates the implementation for you to review before anything is applied. Re-running the audit is what confirms a fix worked. A free account adds a project, so a re-scan can tell you what changed. Pro adds scheduled weekly or monthly re-scans, the full history, and an email when something that was passing starts failing. ### How long does a scan take? Most scans complete in under 30 seconds. Each scan reads your homepage plus up to four more important pages — chosen from your sitemap and your homepage links — along with robots.txt, sitemap.xml and llms.txt. If your server is slow the scan reads fewer pages rather than timing out, and the report says exactly which pages it read and which it skipped. ### How is my data handled? We only store scan results, never full page HTML. Everything is encrypted in transit with TLS, and our managed database provider encrypts data at rest. Scans run without an account are deleted automatically after 90 days; scans in an account are kept until you delete it, which you can do yourself from Settings at any time. ## Contact - Support: support@aisearchaudit.pro - Security: security@aisearchaudit.pro - Founder: Akash Yadav - X: https://x.com/akashyadav_dev ## Notes for crawlers - Auth screens, the dashboard and individual scan reports are private and noindexed; do not crawl them. - Sitemap: https://www.aisearchaudit.pro/sitemap.xml