How about using:
debug => DEBUG_URL | DEBUG_SKIPPED | DEBUG_FAILED | DEBUG_HEADERS,
within your @servers
On Jan 27, 2006, at 9:45 AM, andy rosbrook wrote:
> Well i just want to know after each URL in spider.config weather the
> spidering was a success or a failure. I know i could just check for a
> complete index.swish-e but this doesnt allow me to capture any error
> Ill take a look at grabbin STDERR though, thanks.
>> From: Bill Moseley <firstname.lastname@example.org>
>> Reply-To: email@example.com
>> To: Multiple recipients of list <firstname.lastname@example.org>
>> Subject: [SWISH-E] Re: Callback Functions For Indexing
>> Date: Fri, 27 Jan 2006 07:21:45 -0800 (PST)
>> On Fri, Jan 27, 2006 at 06:30:56AM -0800, andy rosbrook wrote:
>>> Is there anyway to use a callback function to catch errors when
>>> websites with spider.pl?
>>> I am currently spidering only a few small sites at a time and
>>> need a way
>>> knowing weather the spider successfully indexed the site or not,
>>> is this
>>> possible? if so is there a way of grabbing the error message into
>> Not sure what you mean. You want to know if any file returned a
>> non-200 status? Or if swish-e indexed any words?
>> IPC::Open3 will capture stderr and stdout.
>> Bill Moseley
>> Unsubscribe from or help with the swish-e list:
>> Help with Swish-e:
> Are you using the latest version of MSN Messenger? Download MSN
> 7.5 today! http://messenger.msn.co.uk
William M. Conlon, P.E., Ph.D.
To the Point
345 California Avenue Suite 2
Palo Alto, CA 94306
vox: 650.327.2175 (direct)
Received on Fri Jan 27 10:24:18 2006