Google Crawler Documentation Has A New IP List

April 27, 2024

Google updated their Googlebot and crawler documentation to add a range of IPs for bots triggered by users of Google products. The names of the feeds switched which is important for publishers who are whitelisting Google controlled IP addresses. New List Of IP AddressesGoogle says that the list contains IP ranges that have long been in use, so they’re not new IP address ranges. These are apps that are on Google cloud or apps scripts that are called from Gooogle Sheets. Previously the list that corresponded to Google IP addresses was this one: special-crawlers.json (resolving to gae.googleusercontent.com)Now the “special crawlers” list corresponds to crawlers that are not controlled by Google.

The source of this news is from Search Engine Journal