Free tools
Quick checks of single files, free and without an account. For the full picture, including firewalls, structured data and what crawlers actually receive, run the full check.
robots.txt checker for AI crawlers
Free: see which AI crawlers your robots.txt allows or blocks, crawler by crawler, following RFC 9309.
Open →llms.txt validator
Free: check that your llms.txt follows the llmstxt.org format: title, summary, sections and links.
Open →Full AI crawler check
Fetches your page as 16 AI and search crawlers next to a real browser and returns a score with fixes.
Run the full check →