From: Robert Klemme <bob.news@...>
Date: 2005-09-17T18:36:35+09:00
Subject: Re: Optimizing a single slow method

Glenn M. Lewis <noSpam@noSpam.com> wrote:
> Just FYI for anyone following this thread...
> I decided to go ahead and rewrite the file parsing
> section of the code in C++ and interface it to Ruby
> via SWIG (1.3.25), just because I thought the extra
> effort would pay off in the long run with the ability
> to perform a lot more experiments if it took less time
> to run.
>
> Now, with my current database of 16 files totalling
> about 13Megs of information, it takes:
>
> Ruby Only:  29 seconds
> Ruby/C++ :  <2 seconds
>
> So by doing this, I got approximately a 15x speedup.
>
> Please don't misunderstand... I'm *NOT* complaining!!!
> I'm tickled pink that I can use Ruby as a front-end
> for all the cool processing that I want to do on
> the data after I load it in!!!
>
> I only posted this info for those of you who are
> wondering if you can benefit from putting heavy-duty
> I/O in a compiled language... yes you can.  :-)

Hi Glenn,

this sounds like a challenge!  I'd love to get my hands on the input and the 
spec what you want do do with the data to see whether I can find an even 
faster Ruby implementation.  If your data is not private that is. 
Alternatively you could maybe anonymize it...

Kind regards

    robert