I'm indexing a very large dataset, the last benchmark I did was 1,8Gb of
data. Without the -e option my operating system crash, and with -e
option Swish-e takes 1 hour 55minuts of total indexing time and 12m31s
of Cpu indexing time (I don`t know exactly how much memory it taked).
I was wondering if with 500Mb of memory, this time would increase
substantially.
Thanks,
Albert
moseley@hank.org wrote:
>On Fri, Sep 26, 2003 at 04:18:38AM -0700, Albert Vila Puig wrote:
>
>
>>Is there an option to control the memory in the economic mode?. For
>>example, I wanna run the swish with the economic mode and allow it to
>>use 500Mb of main memory, and use the temporary swap files when swish
>>needs more memory.
>>Is this feature available in the current realese?, or maybe I must
>>change the sorce code to add this functionality.
>>
>>
>
>Jose would need to answer, but I think that would take a design change
>in the way indexing works.
>
>Do you find much difference in indexing speed using -e or not?
>
>moseley@mardy:~$ swish-e -i usrdocs -c c
>24735 files indexed. 184345060 total bytes. 20254324 total words.
>Elapsed time: 00:00:57 CPU time: 00:00:48
>(that used 74MB)
>
>moseley@mardy:~$ swish-e -i usrdocs -c c -e
>24735 files indexed. 184345060 total bytes. 20254324 total words.
>Elapsed time: 00:01:07 CPU time: 00:00:56
>(used 25MB)
>
>
>
>
Received on Mon Sep 29 07:41:01 2003