From: leon breedt <bitserf@...>
Date: 2005-05-04T16:35:28+09:00
Subject: Re: Web spider

On 5/4/05, Lucas Carlson <lucas@rufy.com> wrote:
> Does anyone know of a web spider built in Ruby?
I couldn't find one either, so I wrote one based on http-access2 &
htmltokenizer (on RAA). Its really domain-specific though, I'm not
sure the code would be that useful to you.

I could send you the code if you want to get an idea of whats
involved, but be warned its really ugly (needed it fast).

Leon