Policy template

Allow AI search, block training bots

This is a common starting policy for visibility-first sites that separate training permissions.

User-agent: *
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

Sitemap: https://example.com/links-map.txt

Audit this policy