[ruby-core:114670] [Ruby master Bug#19869] Mark skipped test somehow

Issue #19869 has been updated by vo.x (Vit Ondruch).


Ok, adding `TESTS="--show-skip"` makes the difference. Such tests are reported at the end of the run of test suite, e.g.:

~~~
 70) Skipped:
TestGemExtCmakeBuilder#test_self_build_fail [/builddir/build/BUILD/ruby-3.3.0-7c8932365f/test/rubygems/test_gem_ext_cmake_builder.rb:19]:
~~~

That is nice, but I wonder why is it not default? As I can see, this is enabled just for [MinGW](https://github.com/ruby/ruby/blob/8807b0dc96cbb0d0b72cddae2f41dd163589b7cc/.github/workflows/mingw.yml#L141).

Please note that I cannot enable this option via `$TESTOPTS`, which would be probably the right way, because runnint `make check`, this is then feed to [bootstrap runner](https://github.com/ruby/ruby/blob/master/bootstraptest/runner.rb), which does not handle this option :/

----------------------------------------
Bug #19869: Mark skipped test somehow
https://bugs.ruby-lang.org/issues/19869#change-104499

* Author: vo.x (Vit Ondruch)
* Status: Open
* Priority: Normal
* ruby -v: ruby 3.3.0dev (2023-09-05 master 7c8932365f) [x86_64-linux]
* Backport: 3.0: UNKNOWN, 3.1: UNKNOWN, 3.2: UNKNOWN
----------------------------------------
When Minitest was used to execute the Ruby test suite, skipped test were cleanly marked, e.g.:

~~~
[14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = s
~~~

However, with the test-unit the output is:

~~~
[14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = 0.01 s
~~~

This is problematic, because running test suite, I can see that some test were skipped:

~~~
25705 tests, 6108213 assertions, 0 failures, 0 errors, 99 skips
~~~

But I can't tell which. Is there a chance to fix this?



-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- [e-mail]
 To unsubscribe send an email to [e-mail]
 ruby-core info -- https://ml.ruby-lang.org/mailman3/postorius/lists/ruby-core.ml.ruby-lang.org/