Google-Extended

Google · training

name
Google-Extended
operator
Google
purpose
training
ua_substring
(none — token only)
robots_token
Google-Extended
respects_robots
yes
verify
not applicable — makes no HTTP requests
notes
A robots.txt policy token, NOT a crawler. It makes no requests and never appears in logs; disallowing it opts your content out of Gemini/Vertex training while leaving Google Search crawling untouched.
canonical_name
Google-Extended
user_agent_token
Google-Extended
ua_full
— not-applicable
bot_type
opt-out-token
bot_type_extension
opt_out_mechanism
robots.txt disallow (User-agent: Google-Extended) — opts content out of Gemini/Vertex training
published_ip_range_url
— not-applicable
asn
— not-applicable
reverse_dns_suffix
— not-applicable
supports_web_bot_auth
— not-applicable
signature_agent_domain
— not-applicable
jwks_url
— not-applicable
verification_methods
crawl_traffic_share
— not-applicable
targeted_content_type
— not-applicable
documentation_url
https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers
first_seen_date
— verify-against-primary-at-build ↗ https://developers.google.com/search/docs/crawling-indexing/google-extended
last_verified_date
2026-06-15
block_vs_allow_recommendation
decision token — disallow to opt out of Gemini/Vertex training without affecting Google Search ranking; there is no traffic to block.
citation_referral_value
n/a (policy token, not a fetcher)
cloudflare_verified_category
— not-applicable
status
active
triples
["Google-Extended","operated_by","Google"] ["Google-Extended","has_bot_type","opt-out-token"] ["Google-Extended","controls_opt_out_for","Gemini/Vertex training"]
attribute_sources
{"claims":["robots_token","bot_type","opt_out_mechanism","respects_robots"],"source":"https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers","last_verified":"2026-06-15"}

← all The AI Crawler Registry · .md · JSON