From: "Luis G." <l17339@...>
Date: 2010-11-23T21:46:56+09:00
Subject: Re: nokogiri ip ban?

Hi Ammar

Yeah, that's one of the reasons I asked this question, because I though 
that we can solve this issue just changing the user agent or the headers 
or something... Like they have here: 
http://www.ruby-doc.org/stdlib/libdoc/open-uri/rdoc/

Anyway, now I'm using an empty user agent, but I tried to define a user 
agent but the result was the same. I tried something like:

Nokogiri::HTML(open(url, "User-Agent" => "Ruby/#{RUBY_VERSION}"))

I also tried the user agents we can use in Mechanize ('Linux Mozilla', 
for example) but nothing worked.

Luis

-- 
Posted via http://www.ruby-forum.com/.