New Robots.txt Tester Tool in Google Webmaster Tools

Google Webmaster Tools has just added a new robots.txt tester. The new feature will highlight errors and warnings, as well as let you test changes in real-time directly within the tool. Just make sure to upload your final file to your web server when you’re done. In addition, you’ll be able to see older versions of your robots.txt files, making it easy to identify changes that may have blocked Google’s spiders from crawling pages within your site. Find out all the details in “Testing robots.txt files made easier” via Google’s Webmaster Central Blog.