Jordan Hayes wrote on 4/5/09 12:26 AM:
>> I have something like 2-3 million small little XML files
>> in one directory that I'm indexing ...
>
> I'm going to guess that SWISH-E "slows down" due to your OS's directory
> code.
That would surprise me.
I expect rather that you're simply running out of memory and you're swapping, as
you suspected.
I would just split my single dir into 3 and create 3 indexes. Then you could
either merge them (though you might hit the same mem limit) or just search them
together.
might also look at the -e option to swish-e while indexing.
--
Peter Karman . http://peknet.com/ . peter(at)not-real.peknet.com
_______________________________________________
Users mailing list
Users@lists.swish-e.org
http://lists.swish-e.org/listinfo/users
Received on Sun Apr 5 11:47:23 2009