From: Aredridel <aredridel@...>
Date: 2004-08-21T15:59:49+09:00
Subject: Re: ruby-doc.org content snarfing

On Sat, 2004-08-21 at 15:49 +0900, James Britt wrote:
> Aredridel wrote:
> > 
> > James -- is there a possibility of you providing a tarball of the whole
> > site for download?
> > 
> > I'd be more than willing to host a tracker and seed for a Bit Torrent
> > copy of it.
> 
> A tarball of the whole site would be close to 5 GB. That's including the
> videos.  Torrents for the videos might be a good idea; I'm not sure a
> torrent for anything else is all that useful.  There are assorted
> bundles and stand-alone files that are easy to download as needed.  Much
> of the site's content  consists of links to other places.  There's the
> HTML version of Programming Ruby, and the core and standard lib docs.

Yeah, torrents make sense for anything over 10mb.

> Each of these gets updated on a different schedule.  A monolithic
> tarball would be out of date fairly quick.

Yeah -- a few large ones might appease those wanting a copy. I know I've
toyed with the idea. I'd love a copy of good chunks of the site for
offline reading.

> In actual practice, the traffic has been fine.  It's just this one time
> somebody decided to go grab what appears to be *everything*, all in one day.

Ouch. That happened to me once...

> Thank you for the offer, though.  When I first started hosting videos on
> the site  was unfamiliar with bittorrent.  Now, though, it seems as if
> it would be a good option for the larger files.

Yeah.

Have a good one.

Ari