On Wed, Jan 28, 2004 at 08:33:45PM -0500, Rob de Santos AFANA wrote:
> One other problem has cropped up. We have a picture gallery application
> done in php ("Gallery") which allows users to view sets of pictures.
> The gallery directory itself is off limits to robots via robots.txt but
> the pics are in subdirectories of a directory called /album/. That is
> open to spidering but for some reason swish-e doesn't index the
> subdirectories of /album/. I tried this in the swish-e config file but
> it didn't work:
> http://www.afana.com http://www.afana.com/blog/archives/
> obeyRobotsNoIndex yes
That's for the -S http method of indexing so it doesn't apply to -S prog
Are there any links to follow in /album/?
Received on Wed Jan 28 18:47:11 2004