Comments on: MSRBOT http://cleverhack.com/2006/08/29/msrbot/ Technology, Startups, Internet Marketing Tue, 22 May 2012 05:39:18 +0000 http://wordpress.org/?v=2.0.2 by: Freesitebuilder http://cleverhack.com/2006/08/29/msrbot/#comment-41512 Thu, 22 Mar 2007 14:06:21 +0000 http://cleverhack.com/2006/08/29/msrbot/#comment-41512 I've had this too, using 209.133.64.213, but it shows the referrer as http://blogger.com The whois gave me this: Search results for: 209.133.64.213 OrgName: Abovenet Communications, Inc OrgID: ABVE Address: 360 Hamilton Ave City: White Plains StateProv: NY PostalCode: 10601 Country: US ReferralServer: rwhois://rwhois.above.net:4321 So if it is the MS research bot, why does it say Blogger? I’ve had this too, using 209.133.64.213, but it shows the referrer as http://blogger.com

The whois gave me this:

Search results for: 209.133.64.213

OrgName: Abovenet Communications, Inc
OrgID: ABVE
Address: 360 Hamilton Ave
City: White Plains
StateProv: NY
PostalCode: 10601
Country: US

ReferralServer: rwhois://rwhois.above.net:4321

So if it is the MS research bot, why does it say Blogger?

]]> by: Michael Hampton http://cleverhack.com/2006/08/29/msrbot/#comment-24752 Tue, 19 Sep 2006 13:16:48 +0000 http://cleverhack.com/2006/08/29/msrbot/#comment-24752 The research group running "MSRBOT" is apparently based in Silicon Valley, rather than Redmond... The research group running “MSRBOT” is apparently based in Silicon Valley, rather than Redmond…

]]> by: James http://cleverhack.com/2006/08/29/msrbot/#comment-24570 Sun, 03 Sep 2006 11:43:23 +0000 http://cleverhack.com/2006/08/29/msrbot/#comment-24570 I also got a total crawl from MSRBOT at 209.133.64.221. It was preceded by a short look at robots.txt by "msnbot/1.0 (+http://search.msn.com/msnbot.htm)" so it may be legit though I can not see why they are using a block of addresses out of San Jose. The msnbot crawls my site regularly as it is. I am inclined to block this one until they cough up a good reason for the additional bandwidth they are taking. I have had a few that were resistant to a robots.txt ban and had to be blocked at the firewall. MSNBOT has not always been a good netizen either. I also got a total crawl from MSRBOT at 209.133.64.221. It was preceded by a short look at robots.txt by “msnbot/1.0 (+http://search.msn.com/msnbot.htm)” so it may be legit though I can not see why they are using a block of addresses out of San Jose. The msnbot crawls my site regularly as it is. I am inclined to block this one until they cough up a good reason for the additional bandwidth they are taking. I have had a few that were resistant to a robots.txt ban and had to be blocked at the firewall. MSNBOT has not always been a good netizen either.

]]> by: joy http://cleverhack.com/2006/08/29/msrbot/#comment-24561 Sat, 02 Sep 2006 16:29:57 +0000 http://cleverhack.com/2006/08/29/msrbot/#comment-24561 I don't believe it's Microsoft running this particular bot. I don’t believe it’s Microsoft running this particular bot.

]]> by: bruce http://cleverhack.com/2006/08/29/msrbot/#comment-24549 Thu, 31 Aug 2006 22:23:09 +0000 http://cleverhack.com/2006/08/29/msrbot/#comment-24549 A bot identified as 'MSRBOT' has been hammering my site from the 209.133. range. I can't imagine that it's legitimately from Microsoft, unless they are conducting research from San Jose... A bot identified as ‘MSRBOT’ has been hammering my site from the 209.133. range. I can’t imagine that it’s legitimately from Microsoft, unless they are conducting research from San Jose…

]]>