What is Google-Extended?
Published . Updated .
Google-Extended: A robots.txt token that tells Google whether content it crawls may be used to train its Gemini models and to ground answers in Gemini Apps.
Google-Extended has no user agent of its own: Google crawls with its usual crawlers, such as Googlebot, and checks the token. Google says it does not affect whether a page is included or ranked in Google Search.
It is the Google counterpart to blocking GPTBot or ClaudeBot. Set it in robots.txt.
Read next
Sources
See the fan-out for your own prompts
Only Fan Out is a free Chrome side panel that lists the queries, fetched pages and cited pages behind each ChatGPT, Claude or Grok answer. Nothing leaves your browser.
Add to Chrome, it's free