On Wed, Sep 29, 2004 at 07:31:35AM -0700, Jon Sorensen wrote:
> I'm trying to spider a number of sites with spider.pl and I need to index
> https secure sites
> This is all I found in the discussion archives:
> 
> http://www.swish-e.org/Discussion/archive/2000-06/1902.html

Try this:

  http://swish-e.org/current/docs/spider.html

and search for "SSL" -- doesn't say much other than you need to
install SSL support for the lwp library.

SSL adds overhead.  I'd tend to setup a separate non-ssl web server
just for spidering if possible.

-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu