From: Dan Cuddeford <dancudds@...>
Date: 2008-01-23T20:50:29+09:00
Subject: Re: Parsing HTML / following links etc

Mmmm thanks for your advice. One thought - is it possible to get ruby is 
run wget externally and pull into a directory and then set ruby off to 
do its magic once this is done?


Florian Ebeling wrote:
>> wget http://www.digg.com -r -l 2 will digg down two layers from the
>> html such as  images so I explored html-parsing but they all seemed to
>> be geared towards manipulation rather than downloading information for
>> manipulation later :(
> 
> you might want to try the hpricot (!) gem, but that covers only
> html parsing. then you use the standard html client and pull
> the documents you fancy.
> 
> a regular http client library does not typically include getting
> all referenced objects, this is rather a higher-level 'application'
> feature.

-- 
Posted via http://www.ruby-forum.com/.