[ic] RobotUA

[interchange-users@icdevgroup.org (Philip S. Hempel)]

Grant wrote:

>>Grant [listbox@email.com] wrote:
>>    
>>
>>>I just defined RobotUA in my 4.9.3 store, and I was wondering if anyone
>>>would be willing to post their list of spider UAs.  Here's mine:
>>>
>>>RobotUA *google*, *Google*, *scooter*, *Scooter*, *spider*, *Spider*,
>>>*ultraseek
>>>*, *Ultraseek*, *infoseek*, *Infoseek*, *lycos*, *Lycos*, *sidewinder*,
>>>*Sidewin
>>>der*, *architext*, *Architext*, *gulliver*, *Gulliver*, *mercator*,
>>>*Mercator*,
>>>*slurp*, *Slurp*
>>>
>>>      
>>>
>>Here's mine:
>>
>>RobotUA <<EOR
>>   ATN_Worldwide, AltaVista, Arachnoidea, Aranha, Architext, Ask, Atomz,
>>   BackRub, Builder, CMC, Contact, Digital*Integrity, Directory, EZResult,
>>   Excite, FAST, Ferret, Fireball, Google, Gromit, Gulliver,
>>Harvest, Hubater,
>>   H?m?h?kki, INGRID, IncyWincy, Jack, KIT*Fireball, Kototoi, LWP, Lycos,
>>   MegaSheep, Mercator, Nazilla, NetMechanic, NetResearchServer, NetScoop,
>>   Offline, ParaSite, Refiner, RoboDude, Rover, Rutgers, Scooter, Slurp,
>>   Spyder, T-H-U-N-D-E-R-S-T-O-N-E, Toutatis, Tv*Merc, Valkyrie, Voyager,
>>   WIRE, Walker, WebCopier, Wget, WhizBang, Wire, Wombat, Yahoo, Yandex,
>>   ZyBorg, agent, ah-ha, appie, archiver, asterias, bot, contact,
>>collector,
>>   crawl, fido, find, gazz, grabber, griffon, ip3000, legs,
>>marvin, mirago,
>>   moget, newscan, roach, seek, speedy, spider, suke, tarantula,
>>topiclink,
>>   whowhere, winona, worm, xtreme,
>>EOR
>>    
>>
>
>Nice list!  Where'd you get it?  Do you think there's a chance of any
>"false-positives" with that list?
>
>- Grant
>
>
>  
>
Here is another location for curent spiders on the net

http://www.robotstxt.org/wc/active.html
-- 
Philip S. Hempel