RE: [mv] MV goes down, because a robot have visited my site!

["Otis Gospodnetic" <otis@DOMINIS.com>]

You can maybe try stopping this robot at the Web server level. Here is an
example for Apache:

#OG deny bad user-agents (e.g. email grabbers)
SetEnvIfNoCase User-Agent "EmailSiphon"         BADUA
SetEnvIfNoCase User-Agent "ExtractorPro"        BADUA
SetEnvIfNoCase User-Agent "CherryPicker"        BADUA
SetEnvIfNoCase User-Agent "EmailCollector"      BADUA
SetEnvIfNoCase User-Agent "EmailWolf"           BADUA
SetEnvIfNoCase User-Agent "NICErsPRO"           BADUA
SetEnvIfNoCase User-Agent "WebBandit"           BADUA
SetEnvIfNoCase User-Agent "Telesoft"            BADUA

<Location />
       order allow,deny
       allow from all
       deny from env=BADUA
</Location>


Otis

> -----Original Message-----
> From: owner-minivend-users@minivend.com
> [mailto:owner-minivend-users@minivend.com]On Behalf Of Hans-Joachim
> Leidinger
> Sent: Saturday, October 23, 1999 7:31 AM
> To: minivend-users@minivend.com
> Subject: Re: [mv] MV goes down, because a robot have visited my site!
>
>
> ******    message to minivend-users from Hans-Joachim Leidinger
> <hans-joachim.leidinger@home.gelsen-net.de>     ******
>
>
>
> Ryan Hertz wrote:
> > >
> > >http://www.altavista.com/av/content/addurl_exclude.htm
> > >
> > >
> >
> >         Personally, even with a robots.txt file excluding 'bots
> from my store, I
> > still get a few coming in.  Especially from non-US sites, where they
> > probably don't follow the same conventions.  I would look more into the
> > lockout command.
> >
>
> This is right. I have heard, that some robots donīt read the robot.txt
> files. After my holiday, i will be create a robot.txt, .htaccess and
> later the lockout command.
>
> Is it possible to patch the minivend to deny this robot? What i mean is,
> is minivend not able to block this robot and to prevent any access by
> this robot dynamically? If minivend is able to log message (BAD ROBOT)
> into the error log, is minivend not able to deny all access from this
> robot?
>
> Can someone explain me, why MV goes down after a robot has visited the
> shop? Is there an extra exit codes? Or what is the problem with robot?
> Or what is the cause to break the minivend server running?
>
> Regards,
>
> Joachim
>
> --
> -------------Hans-Joachim Leidinger---------------------
>
> -
> To unsubscribe from the list, DO NOT REPLY to this message.  Instead, send
> email with 'UNSUBSCRIBE minivend-users' in the body to
> Majordomo@minivend.com.
> Archive of past messages: http://www.minivend.com/minivend/minivend-list
>