The Saga Of John Mueller’s Freaky Robots.txt

March 15, 2024

SEO Subreddit PostThe saga of John Mueller’s robots.txt started when a Redditor posted that John Mueller’s website was deindexed, posting that it fell afoul of Google’s algorithm. Here’s the top part of Mueller’s robots.txt which features a commented Easter egg for those taking a peek. One of directories blocked by Mueller’s robots.txt is /nofollow/ (which is a weird name for a folder). My robots.txt file just has a lot of stuff in it, and it’s cleaner if it doesn’t get indexed with its content. John Mueller’s weird robots.txt.

The source of this news is from Search Engine Journal