[Date Prev][Date Next][Thread Prev][Thread Next][Minivend by date
][Minivend by thread
]
Re: robot causing problem
Quoting Kyle Cook (kyle@invisio.com):
> ****** message to minivend-users from Kyle Cook <kyle@invisio.com> ******
>
> Mike, or anyone:
>
> I had a robot come through and ramp the server up to a load
> of 8.0 before I was able to stop it. After emailing back and
> forth with the company responsible (gifwizard.com) they
> had this to say:
>
>
> >The link checking does a "HEAD" request instead of a GET.
> >So if the CGI program checks the REQUEST_METHOD environment
> >variable and sees "HEAD" all it is supposed to do is
> >return if the page exists, not the actual page. This is a
> >standard feature for http servers. If the HEAD is not responded
> >to then we try a GET. I think that is happening in your case.
Much more properly handled at the web server or in the link program.
--
Mike Heins http://www.minivend.com/ ___
Internet Robotics |_ _|____
131 Willow Lane, Floor 2 | || _ \
It's a little-known fact Oxford, OH 45056 | || |_) |
that the Y1K problem caused <mikeh@minivend.com> |___| _ <
the Dark Ages. -- unknown 513.523.7621 FAX 7501 |_| \_\