* Robots.txt Checker
Robots.txt Checker: Find blocking errors.
Free robots.txt validator. We parse your robots.txt, validate its syntax, and cross-check every Disallow rule against your sitemap to find URLs you are accidentally blocking.
Try:
M
S
J
A
R
★★★★★
Trusted by SEOs and founders
Common questions
What does the robots.txt checker analyze?
We fetch your robots.txt, validate its syntax, check each Disallow rule against your actual sitemap URLs, and flag pages accidentally blocked from crawling.
Can I check robots.txt without a sitemap?
Yes. Enter your domain and we parse the robots.txt directly. We also cross-check against your sitemap if one exists to catch conflicts.
Will it detect conflicts with my sitemap?
Yes. If your sitemap lists URLs that robots.txt blocks, we highlight every conflict - one of the most common SEO mistakes we find.