Skip to main content.
home | support | download

Back to List Archive

Re: Crossplatform Swish-e Index

From: Ziegenhorn, Eric <eric.ziegenhorn(at)not-real.ngc.com>
Date: Mon May 24 2004 - 22:11:31 GMT
Thanks Bill.  I've been on the list for a while, and I must say your dedication and helpfulness is impressive and inspiring.

-----Original Message-----
From: Bill Moseley [mailto:moseley@hank.org]
Sent: Monday, May 24, 2004 3:07 PM
To: Multiple recipients of list
Subject: [SWISH-E] Re: Crossplatform Swish-e Index


On Mon, May 24, 2004 at 02:42:23PM -0700, Ziegenhorn, Eric wrote:
> Speaking of 64-bit/32-bit incompatabilities, what is the status of 64
> bit support in Swish-e?  Several months ago I was trying to index
> several hundred gigabytes of documents, and I couldn't get it to work.
> The thought then was that 64-bit support would enable me to do my job.
> Since then I've tried using MySQL 4.1 and its full text indexing which
> is nice but fraught with problems at this point.  So, I'm wondering
> how swish-e is dealing with large amounts of data on 64-bit platforms
> these days.  Any obervations would be appreciated!

Seeing how you can't do true incremental indexing in swish-e, swish-e
probably isn't the right tool for that much data.  Jose did update
swish-e to work with very large position numbers (someone was having
problems with very large documents) and he also has done work on 64bit
architecture in that past.  Just seems like the time and perhaps memory
required for indexing would make it not the best choice.



-- 
Bill Moseley
moseley@hank.org
Received on Mon May 24 15:11:31 2004