Google Updates Crawler Documentation To Fix A Typo

September 14, 2023

Google has fixed a typo in their crawler documentation that inadvertently misidentified one of their crawlers. Failure to notate the correct data could cause a website to inadvertently block a legitimate Google crawler. Google Inspection ToolThe typo is in the section of the documentation about the Google Inspection Tool. Why Crawler User Agent Typo Error is ProblematicThis can become a troublesome issue for websites that are behind a paywall but whitelist specific robots, such as the Google-InspectionTool user agent. Hard To Spot User Agent TypoThe issue involved a difficult to catch typo in the user agent description.

The source of this news is from Search Engine Journal