Interchange Developer Resource
[Date Prev][Date Next][Thread Prev][Thread Next][Interchange by date ][Interchange by thread ]

[ic] AOL spiders



AOL spiders don't have anything unique in their User Agent, but their
hostname could be used to trap them with something like "spider*aol".  Is
there any way to set functionality like RobotUA's using the spider's
hostname info?

- Grant



Search for: Sort by: