Google Clarifies the “Google-Extended” Crawler Documentation

February 09, 2024

Google recently updated the documentation of its Google-Extended web crawler user agent, reflecting changes in product naming and clarifying the impact on search, which may be a concern for those who choose to block the crawler. Google-Extended User AgentIntroduced on September 28, 2023, Google-Extended offers web publishers a user agent that can be used to control how their sites are crawled. Google describes Google-Extended as a “standalone product token” but that’s non-standard terminology for how publishers understand the concept of User Agents. The revision comes after the renaming of Bard to Gemini Apps, specifying that Google-Extended’s indexing now contributes to Gemini Apps and Vertex AI generative APIs. Google’s changelog clarifies that Google-Extended crawling is exclusive to Gemini Apps and has no impact on Google Search.

The source of this news is from Search Engine Journal