On Fri, Mar 18, 2005 at 04:03:25PM -0800, Thomas Angst wrote:
> after I followed the advice of Bill Mosley and I use an external Program 
> to walk thru the files, the memory usage of swish-e is exploding. It 
> seems swish-e stores the whole output of  the tracer program until the 
> memory and swapfile is full and then swish-e collapse sometimes it takes 
> slapd with in the grave. What can I do to fix that problem? Here are my 
> testfiles:

I checked in a fix.  Again, use TXT2 instead.  Just as fast when
indexing nothing.

If you are trying to index just the path names you will need to set
the No-Contents: 1 header, otherwise swish will assume the document
is empty and bypass it.  Or use the locate utility, as was suggested.

BTW -- thank you for providing a complete test case.  Makes it so
much easier to debug.




> 
> There is no difference between normal and economy mode
> call: swish-e [-e]  -c swish-e.conf -S prog
> 
> swish-e.conf
> ---------------------------------------------
> IndexDir ./test.sh
> IndexFile index.test
> 
> StoreDescription HTML* <content> 20000
> StoreDescription XML*  <text:p> 20000
> StoreDescription TXT 20000
> ---------------------------------------------
> 
> test.sh
> ---------------------------------------------
> #!/bin/sh
> typeset -i nr=0
> while [ $nr -le 100000 ] ; do
>   # only a long path to fill the memory, but no content
>   echo "Path-Name: 
> file://///server/path/spartux/src/spartux/debian/deb/dev/fd/4/spartux/src/spartux/debian/deb/dev/fd/4/spartux/src/spartux/debian/deb/dev/fd/4/spartux/src/spartux/debian/deb/dev/fd/4/spartux/src/spartux/debian/deb/dev/fd/4/spartux/src/spartux/debian/deb/dev/cciss/c1d13p3"
>   echo "Content-Length: 0"
>   echo "Document-Type: TXT"
>   echo ""
>   nr=$nr+1
> done
> ---------------------------------------------
> 
> 
> 

-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu