Force Google to update robots.txt using Webmaster tools

Webmaster tools does not allow forced updating for testing your robots.txt. Using this method you can force Googlebot to refresh it and verify changes switfly, instead of waiting for an automatic update.

1. login to Google Webmasters and select the verified site you want to work with.

webmaster tools a

2. Open "Crawl > robots.txt Tester". And see your current robots.txt (according to Google's cache).

webmaster tools 1

3.Open "Crawl > Fetch as Google" and do a request for /robots.txt. After the fetch is complete click the "Submit to index" button and only crawl this URL (this has a limit of 500 per month).

webmaster tools 2

4. Behold, your robots.txt is updated.

webmaster tools 3