Free browser tool

AI robots.txt checker

Paste a robots.txt file and check whether it has a sitemap, a general crawler policy, AI search crawler access, and a separate policy for training crawlers.

robots.txt User-agent: * Allow: / User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Disallow: / Sitemap: https://example.com/links-map.txt

How to read the result

This checker is a practical review, not a guarantee of inclusion in AI answers. If AI visibility is the goal, avoid blocking search-oriented crawlers by accident and keep your sitemap and source pages crawlable.