Speedy Spider is the crawler for the Sweden based search engine Entireweb. I have not seen any referrers from Entireweb, but their Speedy Spider featured a URL to the informative Speedy Spider FAQ. In addition, Speedy Spider is quite polite for a bot, only crawling one or two pages per request.

Host: 62.13.25.220
/robots.txt
Http Code: 200 Date: Nov 19 06:57:54 Http Version: HTTP/1.0 Size in Bytes: 6702
Referer: -
Agent: Speedy Spider (Entireweb; Beta/1.0; http://www.entireweb.com/about/search_tech/speedyspider/)

Technorati Tags: Search Engine, bot, crawler, spider, Entireweb, Speedy Spider

This entry was posted on Monday, November 20th, 2006 at 11:47 pm and is filed under Tech, Internet. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Comments are moderated, so expect a small delay between posting and viewing your comment on the site.