Moved to Cloudflare? Check that AI crawlers still get in
Bot protection, "Block AI bots" and WAF rules are on by default in many Cloudflare setups. They can turn AI search crawlers away without any error on your side.
Free · No signup · Results in 30 seconds
What blocks them
Bot Fight Mode, AI bot blocking, managed challenges and custom WAF rules that match a crawler's user agent or its network.
What we check
Your pages fetched as 16 AI and search crawlers next to a normal browser, with the status code and the Cloudflare header that shows a block.
Keep it in check
Rules change. Monitoring rechecks your key pages and emails you when a crawler is shut out again.
After a redesign · After moving to Shopify · After a robots.txt change