From: Kirk Haines <wyhaines@...>
Date: 2005-03-22T00:34:50+09:00
Subject: Re: Free Rails hosting?

Doug Beaver wrote:

> that's pretty good performance, although it's difficult to assess
> without knowing what your app is doing.  this is why it will be great to
> get some good, relative benchmarks between the different frameworks out
> there.

Yep yep.  Meaningful benchmarks can be hard.
 
>> The trick with this sort of comparison is in comparing apples to
>> apples.  I have long been interested in writing an article or three
>> that compares implementation details and then performance of some task
>> or tasks in Ruby and non-Ruby frameworks.  It's not an easy task,
>> though.  The choice of fair benchmarks, and then the task of getting
>> good, equivalent implementations of the task(s) under the frameworks
>> to be compared is fraught with challenges.  Anyone want to help?
> 
> i agree it's hard to do fair benchmarks, but i think it's definitely
> doable.  are you thinking just ruby and java?  i would be glad to help
> out with this, i have some background in performance testing.

I'm thinking primarily to look at Ruby approaches, but with rolling in a
comparison with some common Java standard approach, and perhaps a Perl
and/or Python standard approach, as well.


Kirk Haines