Perplexity crawler guide
PerplexityBot robots.txt guide
PerplexityBot is Perplexity's documented crawler for indexing pages. Perplexity says pages blocked in robots.txt will not have full or partial text indexed, though a domain, headline, or brief factual summary may still appear.
Visibility-first policy
User-agent: PerplexityBot
Allow: /
Sitemap: https://example.com/links-map.txtIf your goal is to appear in Perplexity answers, allow the crawler and make sure your strongest pages answer questions directly. Blocking the crawler is a content-control decision, but it can reduce answer visibility.
Real-world decision pattern
For service sites and publishers, a pragmatic rollout is: allow PerplexityBot on evergreen guides and policy pages first, verify logs for stable crawl behavior, then expand to deeper sections once content quality and update process are stable.