http://www.robotstxt.org/wc/active/html/
this is a big list
BUT I can't see the name of the bot of
www.dogpile .com WebCrawler .com
InfoSpace .com
MetaCrawler .com
However this site
http://searchenginewatch.com/webmast...le.php/2167991
says WebCrawler Served by Excite spiders Served by Excite spiders
BUT the only bots I have visiting are
Googlebot
Inktomi Slurp
Unknown robot (identified by 'crawl')
Unknown robot (identified by hit on 'robots.txt')
Voila
WISENutbot
LinkWalker
AskJeeves
Unknown robot (identified by 'spider')
Alexa (IA Archiver)
Unknown robot (identified by 'robot')
Walhello appie
Scooter
So is it one of the unamed ones or
am I missing something?