From: David Masover <ninja@...>
Date: 2008-07-27T14:44:03+09:00
Subject: Re: Faster Marshaling?

On Sunday 27 July 2008 00:33:56 Greg Willits wrote:

> We have talked about skipping Marshaling and going straight to standard 
> text files on disk and then using read commands that point to a specific 
> file line.

If the files aren't changing, you probably want to seek to a specific byte 
offset in the file, rather than a line -- the latter requires you to read 
through the entire file up to that line.

> We haven't spiked that yet, but I don't see it being significantly 
> faster than using a local db (especially since db cache might be 
> useful),

More useful than the FS cache?

> So, yeah, maybe that or even sqlite might be suitable if the RAM thing 
> just gets too obnoxious to solve. Something that would prove to be 
> faster than MySQL.

For what it's worth, ActiveRecord does work on SQLite. So does Sequel, and I 
bet DataMapper does, too.

I mentioned BerkDB because I assumed it would be faster than SQLite -- but 
that's a completely uninformed guess.