Spoofed Googlebot User Agent

Posted by joy

Well, this visitor caught my eye earlier as the originating IP address is from the technology company Oracle but with a Googlebot user agent. Another clue that this is a spoofed user agent is that they came in off of a Google Search Engine referrer, as Googlebot doesn’t usually do that. Also, their browser had requested images off of my server (as browsers usually do) and Googlebot usually does not.

Why would someone spoof Googlebot? Aside from the amusing (and covert) aspects, some Web sites may serve different content to Googlebot — for example, cloaking or doorway pages which are a big Google Webmaster no no (i.e. a Flash or Video based Web site serving text for indexing or a specifically optimized entry page).



Http Code: 200 Date: Sep 19 07:58:51 Http Version: HTTP/1.1 Size in Bytes: 10962

Referer: http://www.google.com/search?hl=en&source=hp&q=droid+user+agent&oq=droid+user+

Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Technorati Tags: , , ,

Leave a Reply