Question
Should I allow Claude-SearchBot?
If AI answer visibility for Claude experiences is your goal, allowing Claude-SearchBot is usually the practical default.
Keep policy roles separate
Claude-SearchBot: search-oriented discovery.ClaudeBot: training-policy crawler bucket.Claude-User: user-triggered retrieval behavior.
Set each policy line explicitly, then confirm with logs instead of assuming wildcard rules did the right thing.