The Story of Blocking 2 High-Ranking Pages With Robots.txt

July 11, 2023

I blocked two of our ranking pages using robots.txt. I blocked these two pages on January 30, 2023:These lines were added to our robots.txt file:Disallow: /blog/top-bing-searches/Disallow: /blog/top-youtube-searches/ResultsAs you can see in the charts below, both pages lost some traffic. I guess that having the pages blocked from crawling made them ineligible for featured snippets. The pages lost their custom titles and displayed a message saying that no information was available instead of the meta description. Additionally, you’ll see the “Indexed, though blocked by robots.txt” status in Google Search Console if you inspect the URL.

The source of this news is from Ahrefs