Skip to main content.
home | support | download

Back to List Archive

Re: enhancement request

From: Bernhard Weisshuhn <bkw(at)not-real.weisshuhn.de>
Date: Thu Sep 16 2004 - 10:04:13 GMT
Sorry, everybody, I just reread that message, and

> > >On Wed, Sep 15, 2004 at 01:37:50PM -0700, Richard Morin wrote:
> > 
> > Richard is saying he thinks SWISH should print the URL of
> > the file it was attempting to spider when the problem occurred.

There may be a point there actually, not that it would help much in
that very situation: The library retrieves robots.txt because it is the
first URL from that site, what does it help you to know the url that
triggered this?

But anyway, sorry for the harsh response,
  bkw
Received on Thu Sep 16 03:04:34 2004