AI Crawler Access Checker
See if ChatGPT, Claude, Perplexity, Google’s AI and 14 other AI bots can reach your site. We check your robots.txt and also visit your site as each bot, so firewall and Cloudflare blocks show up too. Then get a fixed robots.txt in one click.
Enter your site and click Check AI access.
You’ll see which AI bots can reach you, which are blocked, and why.
Bot-by-bot results
Red rows are AI search bots that cannot reach you. Amber rows are training bots you are blocking, which is a choice, not an error.
| Bot | Used for | robots.txt | Live visit | Result |
|---|
The live visit sends each bot’s user agent from our server. It catches firewall and user-agent blocks, which is how most “block AI bots” settings work. Googlebot and Bingbot are checked through robots.txt only, because their real visits are verified by IP address.
Fix your robots.txt
Pick what you want. We keep all your existing rules and sitemaps, remove old AI bot rules, and add a clean AI section.
WordPress with Rank Math: go to Rank Math, then General Settings, then Edit robots.txt, paste and save.
WordPress with Yoast: go to Yoast SEO, then Tools, then File editor.
Any other site: upload the downloaded robots.txt to the root folder of your site (public_html), replacing the old one.
Using Cloudflare? robots.txt does not override a firewall. If bots show “Blocked by firewall”, also check the AI bot blocking settings in your Cloudflare dashboard.