From: Luis Some <l17339@...>
Date: 2010-08-19T18:31:54+09:00
Subject: Timeout exception open-uri

Hello people... I'm kinda new to Ruby, so probably this is just a stupid
question...

I'm crawling some websites to get some information and I'm getting this
error:

/usr/lib/ruby/1.8/net/http.rb:560:in `initialize':
Connection timed out - connect(2) (Errno::ETIMEDOUT)
        from /usr/lib/ruby/1.8/net/http.rb:560:in `open'
        from /usr/lib/ruby/1.8/net/http.rb:560:in `connect'
        from /usr/lib/ruby/1.8/timeout.rb:53:in `timeout'
        from /usr/lib/ruby/1.8/timeout.rb:93:in `timeout'
        from /usr/lib/ruby/1.8/net/http.rb:560:in `connect'
        from /usr/lib/ruby/1.8/net/http.rb:553:in `do_start'
        from /usr/lib/ruby/1.8/net/http.rb:542:in `start'
        from /usr/lib/ruby/1.8/open-uri.rb:242:in `open_http'
        from /usr/lib/ruby/1.8/open-uri.rb:616:in `buffer_open'
        from /usr/lib/ruby/1.8/open-uri.rb:164:in `open_loop'
        from /usr/lib/ruby/1.8/open-uri.rb:162:in `catch'
        from /usr/lib/ruby/1.8/open-uri.rb:162:in `open_loop'
        from /usr/lib/ruby/1.8/open-uri.rb:132:in `open_uri'
        from /usr/lib/ruby/1.8/open-uri.rb:518:in `open'
        from /usr/lib/ruby/1.8/open-uri.rb:30:in `open'
        from ./folder/file.rb:111:in `get_stuff'
        from /usr/lib/ruby/1.8/timeout.rb:62:in `timeout'
        from ./folder/file.rb:109:in `get_stuff'
        from ./folder/file.rb:88:in `each'
        from ./folder/file.rb:88:in `get_stuff'
        from ./folder/file.rb:77:in `get_stuff_subcategories'
        from ./folder/file.rb:74:in `each'
        from ./folder/file.rb:74:in `get_stuff_subcategories'
        from ./folder/file.rb:72:in `each'
        from ./folder/file.rb:72:in `get_stuff_subcategories'
        from ./folder/site.rb:51:in `run'
        from /home/user/NetBeansProjects/project/lib/main.rb:30

This only happen sometimes, and happen specially when my internet
connection is slow. So I assume is because of that (a timeout, or
something like that).

Complete code:

begin
Timeout::timeout(40){
 doc = Nokogiri::HTML(open(begin_url))
 #do some stuff with doc variable
}
rescue Net::HTTPBadResponse => e
 log.error 'Fail!'
 retries_torr -= 1
 if retries_torr > 0
  retry
 end
rescue Mechanize::ResponseCodeError => ex
 log.error 'Fail'
 if retries_torr > 0
  retry
 end
rescue Timeout::Error => e
 log.error 'Fail'
 retries -= 1
 if retries > 0
  retry
 else
  log.error 'Fail opening the page. Check the internet connection.'
 end
end

The exception is generated in this line:

doc = Nokogiri::HTML(open(begin_url))

The thing is, I'm trying to catch that exception and I'm not getting
success with that task. I tried:
rescue Timeout::Error

But didn't work.
Can any of you give me some help here?

Thanks,

Luis
-- 
Posted via http://www.ruby-forum.com/.