Skip to main content.
home | support | download

Back to List Archive

Spider, but not index?

From: David VanHook <dvanhook(at)>
Date: Wed Jun 23 2004 - 13:40:04 GMT
Is there a relatively easy way to get SWISH-E to spider a page (i.e., to
follow all of the links on it), but to not index the contents of that same
page?  I've tried using FileRules title in the config file, but am having no
luck -- I get a Bad Directive error, even when I paste in the code directly
from the online docs.


Dave VanHook
Received on Wed Jun 23 13:40:11 2004