From: Anthony Crumley <anthony.crumley@...>
Date: 2015-02-17T13:58:11+00:00
Subject: [ruby-core:68148] Re: Future of test suites for Ruby

--001a11c14f4ae73e6c050f4917a4
Content-Type: text/plain; charset=UTF-8

FYI...

This patch for a Vagrant setup was created to make it easier for non-MRI
developers to work on RubySpec.  Setting up an environment to compile the
most recent version of MRI can be intimidating and time consuming.  With a
Vagrant setup, developers that are capable of writing specifications can
get up and running in less than an hour without having to worry about
causing problems on their host machine.

https://bugs.ruby-lang.org/issues/10757

Anthony

On Tue Feb 17 2015 at 7:39:35 AM Anthony Crumley <anthony.crumley@gmail.com>
wrote:

> Beniot and SHIBATA,
>
> The reason I started with rubyspec/rubyspec rather than nurse/rubyspec
> was, as SHIBATA mentioned, the 1.9.3 specs had already been removed.  I
> felt like 1.9.3 support would be dropped before the tests were up to date
> so that would save the work of removing them.  Also, it seemed like it
> would be easier to cherry pick new commits from nurse/rubyspec than then
> the other way around.
>
> SHIBATA, I am EXCITED to be able to work with you on RubySpec also.  :)
>
> Anthony
>
> On Tue Feb 17 2015 at 7:29:26 AM Anthony Crumley <
> anthony.crumley@gmail.com> wrote:
>
>> FYI...
>>
>> When I started working through the 2.x issues the results on 2.3 were...
>>
>> 1801 files, 18020 examples, 153894 expectations, 36 failures, 19 errors
>>
>> Now the results are...
>>
>> 1801 files, 18024 examples, 153918 expectations, 16 failures, 12 errors
>>
>> On Tue Feb 17 2015 at 7:16:57 AM Anthony Crumley <
>> anthony.crumley@gmail.com> wrote:
>>
>>> Beniot,
>>>
>>> I have been working on reconciling RubySpec with the 2.x MRI versions
>>> over the last month.  https://github.com/anthonycrumley/rubyspec/
>>> commits/master
>>>
>>> My intention is to:
>>> 1) Get RubySpec updated to run with all the 2.x versions of MRI.
>>> 2) Get the nurse/rubyspec updates since the fork added.
>>> 3) Get the updated RubySpecs into the MRI CI.
>>> 4) Hopefully find that repo a home at either rubyspec/rubyspec or
>>> ruby/rubyspec.
>>>
>>> I agree with you that the RubySpec tests are very valuable and would
>>> LOVE to work with you on them.
>>>
>>> Anthony
>>>
>>> On Tue Feb 17 2015 at 6:59:48 AM Benoit Daloze <eregontp@gmail.com>
>>> wrote:
>>>
>>>> On 17 February 2015 at 13:32, Benoit Daloze <eregontp@gmail.com> wrote:
>>>>
>>>>> - The second step is really to choose a canonical RubySpec repository,
>>>>> to avoid "death by too much forks".
>>>>> This repository should only contain RubySpec tests for practical
>>>>> reasons.
>>>>> We should allow many specs contributors to take part in merging
>>>>> changes and maintaining specs.
>>>>> I think this was a fatal flaw of rubyspec/rubyspec in that too few
>>>>> people had the large burden of merging and maintaining the specs.
>>>>>
>>>>> The main existing repository I see today is nurse/rubyspec.
>>>>> I am thinking the process could be similar to handling pull requests
>>>>> on ruby/ruby in that some contributors would provide feedback and merge
>>>>> them.
>>>>> The CI is very useful in this regard to ensure MRI is not broken
>>>>> inadvertently.
>>>>>
>>>>
>>>> I think it would make sense in that case to move nurse/rubyspec to
>>>> ruby/rubyspec for clarity.
>>>>
>>>

--001a11c14f4ae73e6c050f4917a4
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">FYI...<br><br><div>This patch for a Vagrant setup was crea=
ted to make it easier for non-MRI developers to work on RubySpec.=C2=A0 Set=
ting up an environment to compile the most recent version of MRI can be int=
imidating and time consuming.=C2=A0 With a Vagrant setup, developers that a=
re capable of writing specifications can get up and running in less than an=
 hour without having to worry about causing problems on their host machine.=
</div><div><br></div><div><a href=3D"https://bugs.ruby-lang.org/issues/1075=
7">https://bugs.ruby-lang.org/issues/10757</a><br></div><div><br></div><div=
>Anthony</div></div><br><div class=3D"gmail_quote">On Tue Feb 17 2015 at 7:=
39:35 AM Anthony Crumley &lt;<a href=3D"mailto:anthony.crumley@gmail.com">a=
nthony.crumley@gmail.com</a>&gt; wrote:<br><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><=
div dir=3D"ltr">Beniot and=C2=A0<span style=3D"line-height:19.7999992370605=
px">SHIBATA</span>,<br><br>The reason I started with rubyspec/rubyspec rath=
er than nurse/rubyspec was, as SHIBATA mentioned, the 1.9.3 specs had alrea=
dy been removed.=C2=A0 I felt like 1.9.3 support would be dropped before th=
e tests were up to date so that would save the work of removing them.=C2=A0=
 Also, it seemed like it would be easier to cherry pick new commits from nu=
rse/rubyspec than then the other way around.<div><br></div><div>SHIBATA, I =
am EXCITED to be able to work with you on RubySpec also. =C2=A0:)</div></di=
v><div dir=3D"ltr"><div><br></div><div>Anthony</div></div><br><div class=3D=
"gmail_quote">On Tue Feb 17 2015 at 7:29:26 AM Anthony Crumley &lt;<a href=
=3D"mailto:anthony.crumley@gmail.com" target=3D"_blank">anthony.crumley@gma=
il.com</a>&gt; wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:=
0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><d=
iv>FYI...</div><div><br></div>When I started working through the 2.x issues=
 the results on 2.3 were...<br><br><div>1801 files, 18020 examples, 153894 =
expectations, 36 failures, 19 errors<br></div><div><br></div><div>Now the r=
esults are...</div><div><br></div><div>1801 files, 18024 examples, 153918 e=
xpectations, 16 failures, 12 errors</div></div><div dir=3D"ltr"><br><div cl=
ass=3D"gmail_quote">On Tue Feb 17 2015 at 7:16:57 AM Anthony Crumley &lt;<a=
 href=3D"mailto:anthony.crumley@gmail.com" target=3D"_blank">anthony.crumle=
y@gmail.com</a>&gt; wrote:<br><blockquote class=3D"gmail_quote" style=3D"ma=
rgin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"lt=
r">Beniot,<br><br>I have been working on reconciling RubySpec with the 2.x =
MRI versions over the last month. =C2=A0<a href=3D"https://github.com/antho=
nycrumley/rubyspec/commits/master" target=3D"_blank">https://github.com/<u>=
</u>anthonycru<u></u><u></u>mley/rubyspec/<u></u>commits/master</a><div><br=
></div><div>My intention is to:</div><div>1) Get RubySpec updated to run wi=
th all the 2.x versions of MRI.</div><div>2) Get the nurse/rubyspec updates=
 since the fork added.</div><div>3) Get the updated RubySpecs into the MRI =
CI.</div><div>4) Hopefully find that repo a home at either rubyspec/rubyspe=
c or ruby/rubyspec.</div><div><br></div><div>I agree with you that the Ruby=
Spec tests are very valuable and would LOVE to work with you on them.</div>=
</div><div dir=3D"ltr"><div><br></div><div>Anthony</div></div><br><div clas=
s=3D"gmail_quote">On Tue Feb 17 2015 at 6:59:48 AM Benoit Daloze &lt;<a hre=
f=3D"mailto:eregontp@gmail.com" target=3D"_blank">eregontp@gmail.com</a>&gt=
; wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;bo=
rder-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div class=3D"g=
mail_extra"><div class=3D"gmail_quote">On 17 February 2015 at 13:32, Benoit=
 Daloze <span dir=3D"ltr">&lt;<a href=3D"mailto:eregontp@gmail.com" target=
=3D"_blank">eregontp@gmail.com</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex"><div dir=3D"ltr"><div><div><div>- The second step is really t=
o choose a canonical RubySpec repository, to avoid &quot;death by too much =
forks&quot;.<br></div>This repository should only contain RubySpec tests fo=
r practical reasons.<br></div><div>We should allow many specs contributors =
to take part in merging changes and maintaining specs.<br>I think this was =
a fatal flaw of rubyspec/rubyspec in that too few people had the large burd=
en of merging and maintaining the specs.<br></div><div><br></div>The main e=
xisting repository I see today is nurse/rubyspec.<br>I am thinking the proc=
ess could be similar to handling pull requests on ruby/ruby in that some co=
ntributors would provide feedback and merge them.<br>The CI is very useful =
in this regard to ensure MRI is not broken inadvertently.<br></div></div></=
blockquote><div><br></div></div></div></div><div dir=3D"ltr"><div class=3D"=
gmail_extra"><div class=3D"gmail_quote"><div>I think it would make sense in=
 that case to move nurse/rubyspec to ruby/rubyspec for clarity.<br></div></=
div></div></div>
</blockquote></div></blockquote></div></div></blockquote></div></blockquote=
></div>

--001a11c14f4ae73e6c050f4917a4--