Question

What is GPTBot?

GPTBot is OpenAI's crawler that collects public web content to train future models. It honors robots.txt and is separate from the crawlers that power ChatGPT search (OAI-SearchBot) and live page fetches (ChatGPT-User).

Key facts

Block GPTBot only

User-agent: GPTBot
Disallow: /

Related pages: should I allow GPTBot, what is OAI-SearchBot, OpenAI crawler guide.

Build your AI robots.txt