Skip to main content.
home | support | download

Back to List Archive

Re: a better way to index?

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Fri Mar 07 2003 - 01:27:24 GMT
On Thu, 6 Mar 2003, Hup Chen wrote:

> Method 1:
> index the whole 2M database
> # $parse $source | $swishe -i stdin -S prog -f $pathOut/$test1 -c
> swish.conf

What was the max memory usage?

> Method 1: took 3 hours 13 minutes

Can you run that again with -e and report the time and max memory usage.

As the hash tables fill indexing slows down.

Nice to see merge is working fast.  It was not that long ago that it was
very slow and memory intensive.

BTW -- nice hardware. ;)


-- 
Bill Moseley moseley@hank.org
Received on Fri Mar 7 01:31:06 2003