From: Kyle Hunter <keletmaster@...>
Date: 2008-02-22T10:54:36+09:00
Subject: Efficient file downloading

Hello,

I'm using open-uri to download files using a buffer. It seems very
inefficient in terms of resource usage (CPU is ~10-20% in usage).

If possible, I'd like some suggestions for downloading a file which
names the outputted file the same as the URL, and does not actually
write if the file comes out to a 404 (or some other exception hits).

Current code:
BUFFER_SIZE=4096
def download(url)
  from = open(url)
  if (buffer = from.read(BUFFER_SIZE))
    puts "Downloading #{url}"
    File.open(url.split('/').last, 'wb') do |file|
    begin
      file.write(buffer)
    end while (buffer = from.read(BUFFER_SIZE))
    end
  end
end
-- 
Posted via http://www.ruby-forum.com/.