From: raleighr3 Date: 2008-10-06T23:03:14+09:00 Subject: Re: how to stream or write data into a tar.gz file as if the data were from files? On Sep 15, 1:35 pm, bwv549 wrote: > I have a gazillion little files in memory (each is really just a chunk > of data, but it represents what needs to be a single file) and I need > to throw them all into a .tar.gz archive.  In this case, it must be > in .tar.gz format and it must unzip into actual files--although I pity > the fellow that actually has to unzip this monstrosity. > This maybe be a little late, but better late than never. Have you considered using #1 with a tmpfs and memory mapped files? This isn't exactly portable, but should be pretty fast since as far as tar is concerned your in-memory files just look like a regular filesystem thanks to tmpfs.