From: Robert Klemme <shortcutter@...>
Date: 2008-04-09T15:15:21+09:00
Subject: Re: heavy loop functions slow

On 09.04.2008 00:30, Michael Linfield wrote:
> That would work, but even with marshal dumping the data set is just too 
> large for memory to handle quickly.

Which data set - the range definitions or the output?  I thought this is 
a one off process that transforms a large input file into a large output 
file.

> I think I'm going to move the 
> project over to PostgreSQL and see if that doesn't speed things up a 
> considerable amount, Thanks Robert.

That's of course an option.  But I still feel kind of at a loss about 
what exactly you are doing.  Is this just a single processing step in a 
much larger application?

Cheers

	robert