Skip to main content

Documentation

Getting started with the AI Search Audit platform.

Quick Start

Submit any public HTTPS URL to our scanner and receive a technical audit report within seconds. No account is required for a basic scan.

  1. Navigate to the Scanner page.
  2. Enter a public HTTPS website URL.
  3. Review your technical-readiness report and prioritized issues.

What we scan

The engine analyses the homepage plus a small set of important pages — up to five in total — along with the files served at the site root (robots.txt, sitemap.xml and llms.txt) and the HTTP response and headers for each request. Pages are chosen by ranking URLs the scan has already seen in your sitemap and homepage navigation; the scanner does not crawl outward, and it does not execute JavaScript, so content injected by client-side rendering is not evaluated.

Five pages is a ceiling rather than a promise: if your server responds slowly, the scan analyses fewer pages instead of timing out, and the report says which pages it skipped and why. This is a sample of your site, not a full crawl — every report states exactly what was and was not fetched, and no finding describes a page that was not scanned.

The overall score covers the site-level checks and your homepage. The other pages are scored and reported separately, so a page-level problem is visible without silently changing a number you may be comparing against a previous scan.

Validation methodology

The audit engine applies 31 deterministic, rule-driven checks. No LLM is involved in scoring. Ten checks feed six technical capabilities; the other 21 are advice or information. The headline covers the homepage and site files. If a required observation is missing, the report says assessment incomplete.

  • HTTPS page access — did this scanner receive readable HTML?
  • Public indexability — do the observed directives permit snippets?
  • Page title — is a nonempty title declared?
  • Canonical integrity — are declared canonical URLs usable and consistent?
  • Answer-engine access — what does robots.txt declare, and what did our user-agent probe observe?
  • Content in served HTML — is main content available without JavaScript?

Each finding carries the specific observation behind it, the resource that observation came from, and a confidence value. A check that could not run is reported as such rather than counted as a failure.

AI crawler access

The report separates robots.txt policy from a small homepage user-agent probe. The probe may reveal an observed CDN refusal but cannot test access from a vendor's actual IP addresses. Read how the probe works.

Every report includes a per-crawler access matrix covering 17 known AI crawlers, split by what blocking each one actually costs:

  • Answers & citations (OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot and others) fetch or index pages so an assistant can answer with them and link back. Blocking one removes your site from that assistant entirely, and this is scored.
  • Model training (GPTBot, ClaudeBot, CCBot, Google-Extended and others) collect content that may be used to train a model. Blocking these is a legitimate editorial choice that does not affect whether assistants can cite you, so it is reported but never counted against your score.

Generated fixes

Where a finding has a concrete artifact behind it, AI Search Fixer can generate one from your site's own observed data — a robots.txt block, JSON-LD structured data, an llms.txt drafted from your real navigation, a sitemap.xml, or the missing <head> tags. These are deterministic, not AI-written: every value traces to something this scan saw, or is a clearly marked placeholder for you to fill in. Findings whose fix is a judgement call get written guidance instead of code.

Findings, evidence and recommendations are available without a purchase. AI Search Fixer is a separate one-time purchase that unlocks generated implementation files and the toolkit around them: four skills and two agents your own AI coding assistant runs against your repository, a machine-readable findings.json, per-file implementation instructions and a remediation roadmap. The purchase never gates access to the diagnosis itself.

Rate limits

Anonymous users are limited to a small number of scans per day. Creating a free account raises that limit and unlocks 1 project, which is what lets a re-scan tell you what changed. The Pro plan removes the project cap, keeps your full scan history, re-scans a project automatically every week or month, and emails you when a check that was passing starts failing. Every finding, its evidence and recommendations are included on the free plan; generated implementation files require AI Search Fixer. There is no public API today; it is planned, and this page will say so when it exists.

Support

Need help? Contact support@aisearchaudit.pro.