From: Kev Jackson <kevin.jackson@...>
Date: 2006-03-24T19:42:15+09:00
Subject: Re: scraping websites

Alder Green wrote:

>Hey Kev
>
>Take a look at Rubyful Soup:
>
>http://www.crummy.com/software/RubyfulSoup/
>
>Very easy to parse X/HTML source, including the prevalent
>not-strictly-correct-and-even-somewhat-corrupt sort.
>  
>
I've installed as a gem and now I'm getting unitialized constant 
BeautifulSoup errors

require 'net/http'
require 'rubygems'
require_gem 'rubyful_soup'

class BBCScrape
 
  def read
    Net::HTTP.start("news.bbc.co.uk", 80) do |h|
      response = h.get("/sport1/hi/football/eng_prem/fixtures/default.stm")
      #p response
      s = BeautifulSoup.new response.body <- fails
      p s.find_all('div', :attrs => { 'class' => 'mvb' })
    end
  end
end

I'm not sure what I'm doing wrong and all the documentation doesn't 
refer to gem usage

Sorry if this is me being thick at the end of a Friday...

Thanks
Kev