On Friday 11 November 2005 12:35, FranÃ§ois Tissandier wrote:
> I have a tricky problem I can't solve:
> I have pages like this:
> Basically, it's the same page, except for some content that I don't want
> to index. So I want those two pages to be indexed as one.
> Sadly, the content is slightly different, so the MD5 function is not
> working. So I was wondering if it would be possible to give some rules to
> the spider to tell him
> "link "/tutu/index.html" is OK, but follow "/index.html" instead, please,
> will you?"
> Thanks in advance for your help!
Couldn't you just use your robots.txt file to tell the spider to skip over the
Received on Sat Nov 12 08:18:27 2005