Posted by joy
Yet another third party crawler for a company that is selling what it aggregates. Of course we can’t see what they are aggregating. Their client list is interesting to say the least. Here’s the WebmasterWorld thread about this crawler.
Agent: ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)
Technorati Tags: Internet, Web, site logs, crawlers, user agents
Add this post to your favorite Web 2.0 social bookmarking site:These icons link to social bookmarking sites where readers can share and discover new web pages.
This entry was posted
on Sunday, June 25th, 2006 at 2:20 pm and is filed under Tech, Internet.
You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.
Comments are moderated, so expect a small delay between posting and viewing your comment on the site.
Subscribe to Cleverhack 
