AI search crawler access
7 ptsYour robots.txt rules for OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot and Perplexity-User, on your homepage and key pages. Training bots (GPTBot, ClaudeBot, Google-Extended, CCBot) are reported, never scored.
- Pass
- None blocked
- Warning
- Some blocked, or key pages blocked
- Fail
- All blocked