Hi,

I have had the save problem on hp/ux 10.20 with Swish-e 1.3.2, so I guess 
it will not help. Splitting the index into smaller files and then merging 
the files did the work when I did it this way:
- creating an index for every 200 files.
- merging the indexes 2 by 2 and then repeating. (going from e.g 64 files, 
to 32, 8,4,2,1)

It worked for 11'000 files. Also make sure to include the swish default 
stop words. This helps a bit.

Your system manager might be able to allocate/configure the system so that 
processes are allowed a larger memory space.

Stephane Meier

-----Original Message-----
From: cstephenson@ccmail.uwsa.edu [mailto:cstephenson@ccmail.uwsa.edu]
Sent: 24 juin 1999 19:52
To: swish-e@sunsite.berkeley.edu
Cc: cstephenson@ccmail.uwsa.edu
Subject: [SWISH-E] swish-e dumping core when indexing large file sets


     Hi,
     
     I am trying to index a very large set of text and htm files on an AIX 
     box.  Swish-e (1.1) dumps core on large "chunks" of files.
     
     11126 segmentation fault(coredump)
     rc=139
     
     The solution has been to index smaller chunks of files and then to 
     merge the indexes together.
     
     When merging large index files, swish will dump core also.
     
     Will upgrading to the 1.3.2 version of Swish-e remedy this?  If not, 
     is there another solution?
     
     Thank You,
     
     Craig Stephenson
     cstephenson@ccmail.uwsa.edu
     (608) 265-5775
     Platform Group
     Office of Information Services
     University of Wisconsin System Administration