« Devi

Convera This

Posted by joy


Yet another third party crawler for a company that is selling what it aggregates. Of course we can’t see what they are aggregating. Their client list is interesting to say the least. Here’s the WebmasterWorld thread about this crawler.

Agent: ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)

[tags]Internet, Web, site logs, crawlers, user agents[/tags]


Leave a Reply