How To Control Googlebot’s Interaction With Your Website

The topics discussed were how to block Googlebot from crawling specific sections of a page and how to prevent Googlebot from accessing a site altogether. Blocking Googlebot From Specific Web Page SectionsMueller says it’s impossible when asked how to stop Googlebot from crawling specific web page sections, such as “also bought” areas on product pages. “The short version is that you can’t block crawling of a specific section on an HTML page,” Mueller said. “There’s no need to block Googlebot from seeing that kind of duplication,” he added. In SummaryThough it’s impossible to prevent Googlebot from accessing specific sections of an HTML page, methods such as using the data-nosnippet attribute can offer control.