From: kazaam <kazaam@...>
Date: 2007-08-29T21:45:04+09:00
Subject: Getting all google results with hpricot and connecting two gsub statements to just one?

Hi,
I'm trying to fetch all google results with hpricot. For the first page of results I wrote this here:

	#!/usr/bin/env ruby
	$Verbose=true

	require 'hpricot'
	require 'open-uri'

	google = Hpricot(open("http://www.google.com/search?name=f&hl=en&q=#{$*}"))
	(google/"h2.r/a").each {|line| puts line.to_s.gsub(/^.+href="/,'').gsub(/" .+$/,'')}

So my first question is can I connect the both gsub statments above in just one gsub which should increase the speed? Or is there even a better way than using gsub for cleaning the results?

And the next question is: how can I get all results not just from the first page?

greets

-- 
kazaam <kazaam@oleco.net>