Skip to main content.
home | support | download

Back to List Archive

Re: about the spider

From: Ron Klatchko <ron(at)>
Date: Wed Dec 16 1998 - 22:22:29 GMT
>I'm trying to know what does the SwishSpider do, but
>there are some questions that I can't understand.
>Does anybody know how it works step by step?
>I'll be grated with you, if you answer.

swishspider retrieves a document using the http (or potentially the ftp)
protocol.  It then creates one file that has the http response code and the
documents mime type, another file that contains the actual content of the
document, and a third file that contains all the <A> links in the document.


At 01:39 PM 12/16/98 -0800, Ibon Aizpurua wrote:
>This is a multi-part message in MIME format.
>Content-Type: text/plain;
>	charset="iso-8859-1"
>Content-Transfer-Encoding: quoted-printable
>                                            Ibon Aizpurua
>Content-Type: text/html;
>	charset="iso-8859-1"
>Content-Transfer-Encoding: quoted-printable
><META content=3Dtext/html;charset=3Diso-8859-1 =
><META content=3D'"MSHTML 4.72.2106.6"' name=3DGENERATOR>
><BODY bgColor=3D#ffffff>
><DIV>Hello,<BR>I'm trying to know what does the SwishSpider do, =
>but<BR>there are=20
>some questions that I can't understand.<BR>Does anybody know how it =
>works step=20
>by step?<BR>I'll be grated with you, if you=20
>Ibon Aizpurua</DIV></BODY></HTML>
          Ron Klatchko - Manager, Advanced Technology Group           
           UCSF Library and Center for Knowledge Management           
Received on Wed Dec 16 14:20:25 1998