On Fri, Jan 27, 2006 at 09:44:44AM -0800, andy rosbrook wrote:
> Well i just want to know after each URL in spider.config weather the
> spidering was a success or a failure. I know i could just check for a
> complete index.swish-e but this doesnt allow me to capture any error
> messages.
use test_response callback in your config. That's called right after
the HEAD or GET request has returned (and sometimes before all the
data has be fetched from the remote server).
--
Bill Moseley
moseley@hank.org
Unsubscribe from or help with the swish-e list:
http://swish-e.org/Discussion/
Help with Swish-e:
http://swish-e.org/current/docs
swish-e@sunsite.berkeley.edu
Received on Fri Jan 27 10:23:51 2006