From: lg <lars.gersmann@...>
Date: 2006-03-24T19:43:52+09:00
Subject: Re: scraping websites

i have made good experience using watir (http://wtr.rubyforge.org/ and
http://www.mjtnet.com/watir_webrecorder.htm) - buts its an windows only
thing.

also very usable (and cross plattform) is www:mechanize
(http://www.ntecs.de/blog/Blog/WWW-Mechanize.rdoc).

hope this helps,

lars

Kev Jackson schrieb:

> Hi
>
> I'm considering a side-project where I'd have to scrape a couple of
> websites and aggregate the results.  So far I've done a couple of
> experiments with html-parser, but I'm not really happy with it.  I'd
> hate to just throw regexps at the html, so I'm really looking for an
> elegant way to select the correct data from the page.
> 
> Any ideas on what gems to use?
> 
> Thanks
> Kev