From: Ned Konz <ned@...>
Date: 2001-09-08T02:12:01+09:00
Subject: [ruby-talk:20986] Re: creating lots of files

On Friday 07 September 2001 06:28 am, David Tillman wrote:

>   The simple solution: I added a gdbm interface and stored the files with
>   the filename as the key.
>
>   With 75,000 files the gdbm db was 200Mb and *fast*.
>
>   Not really Ruby related...

Ah, but there is a Ruby interface to the Berkeley DB (called, as I recall, 
"bdb").

In the BerkeleyDB, each key or value can be up to 4Gb long. And it is fast, 
perhaps faster than your file system's handling of multiple files. By giving 
it hints as to page size you can get pretty efficient storage, as well.

-- 
Ned Konz
currently: Stanwood, WA
email:     ned@bike-nomad.com
homepage:  http://bike-nomad.com