robots

When trying to index a WordPress blog on Naver, you will inevitably run into a file called robots.txt. Particularly after learning that Naver’s search crawler is named Yeti, you might wonder: “Do I absolutely have to add Yeti to my robots.txt?” If you check the robots.txt file of a standard WordPress site, it typically looks … Read more