From: Justin Collins <collinsj@...>
Date: 2006-08-24T02:36:42+09:00
Subject: Re: Seeking for a ruby spider robot example

Haofei wrote:
> Hi, i want to write a little spider to do some web search
> but have no idea how to start it. is there any example or something 
> like that?
> thanks :-)
>
> yuesefa

You can see an extremely simple/limited one that I made a while back:

http://students.seattleu.edu/collinsj/programs_netcrawler.html

It may give you a place to start, but there are very good libraries for 
getting and parsing websites, like Rubyful Soup, Mechanize, open-uri, 
and so on.

Also, try searching the archives for more.

-Justin