robots.txt cannot be fetched

robots.unreachable

What it means

robots.txt answered with status 403 or did not answer. Under RFC 9309 crawlers then treat the whole site as disallowed.

Priority

P1

How to fix it

Run a free check of your page. The report shows the evidence for this finding on your site and a ready-to-paste fix: a robots.txt change, a Cloudflare rule, JSON-LD markup, an llms.txt draft or a short instruction.

How to confirm the fix

After the change, press "Check again" on the report: it lists what was fixed and how the score changed.

Check my page →

All findings and how the score works