Testing to confirm that Google bot honours robots.txt and how the request looks in the browsers log.
Does it make the request and have the browser cancel it if it fails the robots.txt test?