From: Chuck Dawit <chuckdawit@...>
Date: 2007-09-19T23:34:26+09:00
Subject: open uri buf read overflow

I'm using open-uri to open approx 3500 web pages to check to see if they
have active contect. I'm using open uri to do it, but after about 2346
pages have been open I get a buf_read error and the program crashes.
After looking in the open-uri documentation I couldn't find anything
that closes the connection and dumps the memory after the open method is
called. Does anyone know how to dump the memory after I make each open()
call?
begin
    while (line = f.readline)
        line  = line.split(/\n/)
        url = "http://www." + line[0] + ".com"
        #puts url
        begin
          open(url) { #|page| page_content = page.read()
    puts url + " exists"
    nf.puts url
        }
    rescue
    puts"URL does not exist"
    #retry
  end
end
rescue EOFError
f.close
nf.close
end
-- 
Posted via http://www.ruby-forum.com/.