how to tell if a web request is coming from google's crawler?

Question

From the HTTP server\'s perspective.

Answer 1

If you're using Apache Webserver, you could have a look at the log file 'log\access.log'.

Then load google's IPs from http://www.iplists.com/nw/google.txt and check whether one of the IPs is contained in your log.