What is GPTBot?
Published . Updated .
GPTBot: OpenAI's web crawler that collects content which may be used to train its foundation models.
OpenAI says disallowing GPTBot in robots.txt opts a site out of training. It does not take the site out of ChatGPT search, which is controlled by OAI-SearchBot.
So a site can stay citable in ChatGPT answers while keeping its pages out of training. The Anthropic equivalent is ClaudeBot.
Read next
Sources
See the fan-out for your own prompts
Only Fan Out is a free Chrome side panel that lists the queries, fetched pages and cited pages behind each ChatGPT, Claude or Grok answer. Nothing leaves your browser.
Add to Chrome, it's free