From: Austin Ziegler Date: 2006-09-16T05:46:12+09:00 Subject: Re: Metaruby, BFTS, Cardinal and Rubicon - State of play? On 9/15/06, Isaac Gouy wrote: > > http://shootout.alioth.debian.org/old/benchmark.php?test=ackermann&lang=perl&id=3 > So you couldn't find that Perl program in the current benchmarks. > We do still show "the obsolete 2001 Doug Bagley Benchmarks", and we > *do* prominently label them "the obsolete 2001 Doug Bagley Benchmarks", > and of course they were not referred to by Kevin Tew. This is not the 2001 benchmark that we're talking about, Mr. Gouy. This is the one that you had that replaced the 2001 benchmark. > > You may have changed the set of benchmarks. > There's no /may/ - the benchmarks were changed a year ago. You snipped the context in your split of the paragraph. The implication here is that I don't think you've changed your methodology, which is what the problem was. Not the benchmarks themselves. > > I'll do some research now > > and see if you've actually cleaned up your methodology. I doubt it, > > but if you have, I'll publicly post an apology. If you haven't, you'll > > clean up your methodology. Otherwise, I'll update my criticisms, but > > you won't get anything positive from me about the shootout. > > > > It will be about two weeks before I can look at this, but I will do so. > > > > Do we have an agreement there? > > Of course not. Then I see no reason to research the issue aside from my own sense of honour. I'll do it, but you have confirmed for me that I'll find exactly what I'm expecting to find and that you haven't done anything to improve your methodology, so you'll be getting no apology unless I find that -- as unlikely as it appears to be -- you have actually changed the methodology you use. Cluebat: your methodology is and always has been the problem. Until that improves, the shootout remains completely useless. -austin -- Austin Ziegler * halostatue@gmail.com * http://www.halostatue.ca/ * austin@halostatue.ca * http://www.halostatue.ca/feed/ * austin@zieglers.ca