robots.txt Tester

Inspect robots.txt directives for user-agent groups, allow/disallow precedence, sitemap hints, crawl-delay portability, and accidental blocking.