Policy template
Allow Claude-SearchBot, block ClaudeBot
Use this policy when you want Anthropic search retrieval access but not training crawler access.
User-agent: *
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: Claude-User
Allow: /
User-agent: ClaudeBot
Disallow: /
Sitemap: https://example.com/links-map.txt