From: Lars Haugseth <njus@...>
Date: 2008-10-01T02:34:00+09:00
Subject: Mirroring large files over HTTP

I'm working on a script where I want to download large files off a remote
web server and store on a local filesystem.

At the moment I'm using code like this:

  require 'open-uri'

  open(filename, 'w') do |file|
    file.write(open(remote_url).read)
  end

I assume this will read the complete content of the remote file into
memory before writing it to the local file. If that assumption is
correct, what is the best/easiest way to do a buffered piecemeal
fetch/store? I've looked at the net/http library but haven't found
anything in there that looks relevant to this.

-- 
Lars Haugseth

"If anyone disagrees with anything I say, I am quite prepared not only to
 retract it, but also to deny under oath that I ever said it." -Tom Lehrer