Skip to main content.
home | support | download

Back to List Archive

spidering, delay_sec and keep_alive

From: J Robinson <jrobinson852(at)not-real.yahoo.com>
Date: Tue Sep 27 2005 - 14:00:26 GMT
Hello Swisheans:

I've noticed that spider.pl in swish-e won't use
$server->{delay_sec} if the spider uses keepalive
connections to the web server.

I'd prefer to have spider.pl respect the delay_sec
setting even if using keepalive connections.

Alternately, there could be a keepalive_delay_sec
setting, but I don't think that's the way to go. I'd
rather have the spider use the delay_sec setting even
if it is using keepalives.

Thoughts? (reference: line 536 of spider.pl.in)
jrobinson


	
		
______________________________________________________ 
Yahoo! for Good 
Donate to the Hurricane Katrina relief effort. 
http://store.yahoo.com/redcross-donate3/ 
Received on Tue Sep 27 07:00:33 2005