Skip to main content.
home | support | download

Back to List Archive

Re: Memory control in economic mode

From: Albert Vila Puig <avp(at)not-real.imente.com>
Date: Mon Sep 29 2003 - 07:40:46 GMT
I'm indexing a very large dataset, the last benchmark I did was 1,8Gb of 
data. Without the -e option my operating system crash, and with -e 
option Swish-e takes 1 hour 55minuts of total indexing time and 12m31s 
of Cpu indexing time (I don`t know exactly how much memory it taked).
I was wondering if with 500Mb of memory, this time would increase 
substantially.

Thanks,
Albert

moseley@hank.org wrote:

>On Fri, Sep 26, 2003 at 04:18:38AM -0700, Albert Vila Puig wrote:
>  
>
>>Is there an option to control the memory in the economic mode?. For 
>>example, I wanna run the swish with the economic mode and allow it to 
>>use 500Mb of main memory, and use the temporary swap files when swish 
>>needs more memory.
>>Is this feature available in the current realese?, or maybe I must 
>>change the sorce code to add this functionality.
>>    
>>
>
>Jose would need to answer, but I think that would take a design change 
>in the way indexing works.
>
>Do you find much difference in indexing speed using -e or not?
>
>moseley@mardy:~$ swish-e -i usrdocs -c c
>24735 files indexed.  184345060 total bytes.  20254324 total words.
>Elapsed time: 00:00:57 CPU time: 00:00:48
>(that used 74MB)
>
>moseley@mardy:~$ swish-e -i usrdocs -c c -e
>24735 files indexed.  184345060 total bytes.  20254324 total words.
>Elapsed time: 00:01:07 CPU time: 00:00:56
>(used 25MB)
>
>
>  
>
Received on Mon Sep 29 07:41:01 2003