Skip to main content.
home | support | download

Back to List Archive

Re: spidering secure sites

From: Bill Moseley <moseley(at)>
Date: Wed Sep 29 2004 - 14:47:39 GMT
On Wed, Sep 29, 2004 at 07:31:35AM -0700, Jon Sorensen wrote:
> I'm trying to spider a number of sites with and I need to index
> https secure sites
> This is all I found in the discussion archives:

Try this:

and search for "SSL" -- doesn't say much other than you need to
install SSL support for the lwp library.

SSL adds overhead.  I'd tend to setup a separate non-ssl web server
just for spidering if possible.

Bill Moseley

Unsubscribe from or help with the swish-e list:

Help with Swish-e:
Received on Wed Sep 29 07:47:53 2004