🤖 Free tool · no signup, no paid API key

AI Bot Access Checker

See exactly which AI crawlers — ChatGPT, Claude, Google's AI Overviews, Perplexity, and more — can and can't read your site.

What This Tool Does

Every AI system that can answer questions about the web — ChatGPT, Claude, Perplexity, Google's AI Overviews — relies on crawlers that first have to visit and read your pages. Those crawlers identify themselves with their own user-agent name (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and a dozen others), and your site's robots.txt file can allow or block each one individually.

This tool fetches a site's public robots.txt, parses the rules the same way a well-behaved crawler would, and reports — bot by bot — whether it's allowed in, fully blocked, or partially restricted.

Why It Matters

  • If a training-only crawler like Google-Extended or GPTBot is blocked, your content simply can't be learned from or cited by that system — invisible in GEO, whatever else you do.
  • Some sites block AI crawlers on purpose (to stop their content training a competitor's model) while deliberately allowing citation-only bots — this tool shows you which policy your site actually has, not which one you think you set.
  • A generic Disallow: / under User-agent: * blocks every AI bot at once, often by accident when a site is trying to block something unrelated (like a scraper) — a five-second check catches this before it costs you visibility.

How to Use It

  1. Enter any domain — yours or a competitor's you're researching.
  2. Click Check Bots. The tool reads that domain's /robots.txt directly (no login, no crawling your whole site).
  3. Read the results: green Allowed, red Blocked, orange Partial (blocked on some paths only).
  4. If a bot you want is blocked, add or edit the matching User-agent block in your robots.txt and re-check.
Enter any domain — yours or a competitor's. We only read that site's public /robots.txt.

Go deeper