robots.txt control token

Google-Extended

Google-Extended is a robots.txt token, not a crawler. Publishers use it to control whether content Google crawls may be used to train future Gemini models and for grounding in Gemini Apps.

Sources: Google's own documentation and the Sill agent registry · checked 15 Nov 2026

Company
Google
Acts for
Google, as a robots.txt control
Follows robots.txt
It is a robots.txt rule
How to verify
No method published

robots.txt

Google says crawling is done with existing Google user agents; Google-Extended only tells Google how crawled content may be used.

User-agent: Google-Extended
Allow: /

How to check it is really Google-Extended

Google-Extended is only a rule name in robots.txt. It never visits, so a request that claims to be Google-Extended is not genuine.

How verification works →

What it does on websites

Google-Extended is a robots.txt rule, not a visitor, so there is no website activity to show.

Other Google agents

Read more on Signals

Questions about Google-Extended

Will blocking Google-Extended remove me from Google Search?

No. Google says it does not affect inclusion in Google Search and is not a ranking signal.

Will I see Google-Extended in my server logs?

No. It has no user agent of its own, so a request that claims to be Google-Extended has failed verification.

Sources

  1. Google: Common crawlers · checked 15 Nov 2026

Official documentation: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers · Spotted an error? Tell us

See which AI agents visit your site, and decide what they may do.

Scan your site free