From: Peter Szinek <peter@...>
Date: 2007-05-07T02:47:34+09:00
Subject: Re: Need advice for a script to scrap my Verizon account

> try http://www.scrubyt.org - great ruby toolkit for webscraping

Yeah, scRUBYt! is really great and all, but currently it has one major 
shortcoming from the viewpoint of verizon scraping: it is built on 
WWW::Mechanize, which can not handle javascript/AJAX and it seems the 
verizon page has plenty of those.

FireWatir is just being integrated into scRUBYt! and scraping such a 
site won't be a problem once it will be finished - however, until then I 
would suggest to use either Watir or FireWatir to handle the AJAXy stuff.

Cheers,
Peter
__
http://www.rubyrailways.com :: Ruby and Web2.0 blog
http://scrubyt.org :: Ruby web scraping framework
http://rubykitchensink.ca/ :: The indexed archive of all things Ruby