From: Vladimir Sizikov <vsizikov@...>
Date: 2008-04-04T19:04:39+09:00
Subject: Re: accomplishing compatibility (was Re: RUBY_IMPLEMENTATION)

Hi henon,

On Fri, Apr 4, 2008 at 11:28 AM, Meinrad Recheis
<meinrad.recheis@gmail.com> wrote:
>
>  I know this has already been discussed some time ago, but IMHO it is
>  very important to point out that a suite of standardized tests which
>  all implementations are tested against is much more practical not to
>  mention much easier to provide than a written specification.

Indeed, this is a critical point periodically discussed here and on
various IRC channels.

>  Have all test suites of all major implementations been merged into the
>  MRI test suite yet? I suspect that not all major implementations use
>  the MRI tests. Should we start a "ruby standardization test suite"
>  project which is maintained by all authors of ruby implementations
>  together? Are there any similar efforts already?

In fact, there is such effort, the "rubyspecs", being currently hosted
in rubinius repository. The spec tests are being used actively, on
*daily* basis but at least Rubinius, JRuby and it seems by IronRuby
too. The tests are being run on Linux, BSD, MacOS, and recently (with
mixed results so far) even on Windows.

There are more than 20.000 test cases there, updated daily. There are
flexible tools to use the specs in Continuous integration manner
(e.g., ability to exclude tests).

Thanks,
   --Vladimr