Hello:

I'm indexing one site with the prog option and I'm using spider.pl to 
spidering. Then, there is a URL that fails, (looking it with the browser it 
returns an error ) and the spider hangs (if I do a ps -awf , It appears as 
defunct). How can I avoid/resolve this? Thank you.