Question

Should I allow Meta-ExternalAgent?

Meta-ExternalAgent is Meta's crawler associated with its AI products. Allow it if you want your content available to Meta AI; block it to opt out. It is separate from Meta's link-preview fetcher, so blocking it does not break Facebook/Instagram link previews.

Decide

Block AI crawl, keep link previews

User-agent: Meta-ExternalAgent
Disallow: /
# Link-preview fetches use a different agent and are unaffected.

Verify

grep -i 'Meta-ExternalAgent' /var/log/your-access.log | awk '{print $7}' | sort | uniq -c | sort -nr | head

Related pages: should I allow GPTBot, should I block Bytespider, AI crawler user agents.

Build your AI robots.txt