Affiliate Marketing
Forum Search

Reply
 
LinkBack Thread Tools Display Modes

  #1 (permalink)  
Old 28-01-05
Mogga's Avatar
Chocaholic
 
Join Date: Aug 2003
Location: Oldham
Posts: 5,485
Thanks: 24
Thanked 13 Times in 8 Posts
Mogga is an unknown quantity at this point
  Bots

http://www.robotstxt.org/wc/active/html/
this is a big list

BUT I can't see the name of the bot of www.dogpile .com WebCrawler .com

InfoSpace .com

MetaCrawler .com


However this site
http://searchenginewatch.com/webmast...le.php/2167991
says WebCrawler Served by Excite spiders Served by Excite spiders

BUT the only bots I have visiting are
Googlebot
Inktomi Slurp
Unknown robot (identified by 'crawl')
Unknown robot (identified by hit on 'robots.txt')
Voila
WISENutbot
LinkWalker
AskJeeves
Unknown robot (identified by 'spider')
Alexa (IA Archiver)
Unknown robot (identified by 'robot')
Walhello appie
Scooter

So is it one of the unamed ones or am I missing something?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored Links
Reply

Bookmarks


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Affiliate Marketing RSS Feeds - Contact Us - Affiliate Marketing - Archive - Privacy Statement - Top

Content Relevant URLs by vBSEO 3.2.0 RC7