Digg Podcasts Crawler

Posted by joy

In case you were curious, here’s the crawler for the Digg podcasts service. There’s no identifying information (either referrer or user agent) on the crawler itself.

Host: (WHOIS)
Http Code: 200 Date: Dec 31 10:15:40 Http Version: HTTP/1.1 Size in Bytes: 62802
Referer: -
Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)

Http Code: 200 Date: Dec 31 10:15:41 Http Version: HTTP/1.0 Size in Bytes: 37811
Referer: -
Agent: -

[tags]Digg, Digg Podcasts, crawler, user agents [/tags]

Leave a Reply