Skip to content
Live42 checked claims
marketinque

Confirm the AI search crawlers can actually fetch you, in the logs

Look for the crawlers that decide citations — OAI-SearchBot, Claude-SearchBot, PerplexityBot, Applebot — not GPTBot or ClaudeBot, which gather training data and say nothing about whether an answer can quote you. Cloudflare blocks AI crawlers by default now, so a site can be invisible without anyone choosing it.

Step 1.3.3.4

Time: 20m

Done when

Count the requests from OAI-SearchBot, Claude-SearchBot and PerplexityBot in the server log that returned 2xx. All three must appear, fetching pages rather than only robots.txt. GPTBot and ClaudeBot do not count: they gather training data, not citations. (Proof: a count.)

In topics

Open in the launch plan

Keep reading

The whole library, sourced.

Topics, plays, terms and the evidence behind each launch-plan step, every claim linked to the page it came from.