November 2, 2026. If you are reviewing a website’s AI policy this month, do not assume that blocking Google-Extended removes the site from every Google AI experience.
The official crawler reference describes Google-Extended as a robots.txt product token governing specified Gemini training and grounding uses. It has no separate HTTP user-agent string, and Google says it is not a Search inclusion or ranking signal.
Search uses a different set of controls
Google’s AI features guidance points to Googlebot crawling rules and preview controls such as nosnippet, data-nosnippet and max-snippet for Search content, alongside noindex. These controls have different effects and should not be treated as interchangeable.
Write down the intended result first
Before editing, identify the provider, product, content and use you want to address. Compare that intention with the current documentation rather than copying a broad blocklist from an unrelated site.
Keep a copy of the existing configuration, review any broader Search consequences and test the implementation through the relevant tools. Do not interpret the absence of a Google-Extended request in server logs as proof that the control was ignored: it is not a separate crawler identity.
This is an explanatory guide, not a change to DigitalNights Media’s settings or a recommendation that every publisher adopt the same policy. Legal rights and contractual permissions are separate questions from the technical scope of a token.
Photo: Ilya Pavlov / Unsplash, Unsplash License. Illustrative stock photograph, not a product screenshot.
