Skip to main content.
home | support | download

Back to List Archive

Re: Spidering phpBB

From: Shaffer, Chris <Chris.Shaffer(at)not-real.BellSouth.COM>
Date: Tue Aug 31 2004 - 14:14:47 GMT
I do...  How would swish know which page to go to, though?

Chris Shaffer
Application Developer, BSTCAD/BSTProcess
BSTCAD Support Forums
chris.shaffer@bellsouth.com


-----Original Message-----
From: swish-e@sunsite3.berkeley.edu
[mailto:swish-e@sunsite3.berkeley.edu] On Behalf Of Bill Moseley
Sent: Tuesday, August 31, 2004 10:12 AM
To: Multiple recipients of list
Subject: [SWISH-E] Re: Spidering phpBB


On Tue, Aug 31, 2004 at 06:20:27AM -0700, Shaffer, Chris wrote:
> Has anyone had any luck spidering a phpBB site?  I tried it, and the 
> spider ran all weekend.  Near as I can tell, it was going in circles.

> I was using MD5, but since the page contents change on every view, 
> that was not helping...

Do you have access to the database?  If so, then it might be easier to
index the content via the database.

-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu
Received on Tue Aug 31 07:15:56 2004