Skip to main content.
home | support | download

Back to List Archive

Re: URL-fixing with callback routines for spider.pl

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Mon May 23 2005 - 14:01:09 GMT
On Mon, May 23, 2005 at 11:24:24AM +0200, koszalekopalek wrote:
> I checked it over the weekend.
> 
>   use_cookies => 1,
> 
> started to work fine as soon as I lied about the user agent in the
> config file:

At least they are not requiring javascript.  I've seen that lately.
But, depending on the user agent (or referer) is never reassuring.



-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu
Received on Mon May 23 07:01:11 2005