# Free AI crawler checker

Enter a domain and see, for every known AI crawler (GPTBot, ClaudeBot,
PerplexityBot and more), whether its robots.txt allows or blocks it for the
domain's homepage path (/). No sign-up, no credit card.

## How it works

The checker fetches https://<domain>/robots.txt and parses it against each
bot's documented robots.txt behavior. A bot shows as Allowed, Blocked,
"Ignores robots.txt" (the operator documents that this bot does not honor
robots.txt at all), or "Blocked in robots.txt (may not be honoured)" (the
operator has not published a clear answer, and robots.txt blocks it).

## Check a domain

https://markethq.ai/tools/ai-crawler-checker

- Full facts on each crawler: https://markethq.ai/ai-crawlers