From: Greg.mpls@...
Date: 2017-11-12T22:53:42+00:00
Subject: [ruby-core:83745] [Ruby trunk Bug#13571] Script arguments, encoding,	windows / MinGW

Issue #13571 has been updated by MSP-Greg (Greg L).


After seeing the CI test issue with [60743](https://github.com/ruby/ruby/commit/7a693278c2897dbcb0bf425dba88cd4555fd6c81), I revisited this with a prior build (ruby 2.5.0dev (2017-11-11 trunk 60742) [x64-mingw32]).

The issue has been resolved, and using the above code, ruby loads both files.  I believe @nobu has been responsible for most of the encoding related commits, so thanks again for your work.

Okay to close.

----------------------------------------
Bug #13571: Script arguments, encoding, windows / MinGW
https://bugs.ruby-lang.org/issues/13571#change-67784

* Author: MSP-Greg (Greg L)
* Status: Open
* Priority: Normal
* Assignee: 
* Target version: 
* ruby -v: ruby 2.5.0dev (2017-05-17 trunk 58774) [x64-mingw32]
* Backport: 2.2: UNKNOWN, 2.3: UNKNOWN, 2.4: UNKNOWN
----------------------------------------
The following is windows/MinGW specific.

I have been patching around a failure in [TestRubyOptions#test_command_line_progname_nonascii](https://github.com/ruby/ruby/blob/trunk/test/ruby/test_rubyoptions.rb#L742-L758) for a while, and decided to investigate further, assuming it was a simple issue.

The following code -

```ruby
# set dir to valid directory
dir = "E:/temp"
fn_1 = '������.rb'
fn_2 = '���������.rb'

puts
puts "ENV['RUBYOPT'] #{ENV['RUBYOPT']}" \
   "\nfilesystem     #{Encoding.find('filesystem')}" \
   "\nexternal       #{Encoding.default_external}" \
   "\n`chcp`         #{`chcp`}" \
     "locale         #{Encoding.find('locale')}" \
   "\n__ENCODING__   #{__ENCODING__}" \
   "\ninternal       #{Encoding.default_internal}\n" \
   "\nfn_1           #{fn_1.encoding.to_s}" \
   "\n������.rb         #{'������.rb'.encoding.to_s}" \
   "\nfn_2           #{fn_2.encoding.to_s}" \
   "\n���������.rb       #{'���������.rb'.encoding.to_s}"

Dir.chdir(dir) do |dir|
  open(fn_1, "w") { |f| f.puts "puts File.basename($0)" }
  open(fn_2, "w") { |f| f.puts "puts File.basename($0)" }
  
  puts
  puts "File.exist?(fn_1)  #{File.exist?(fn_1)}"
  puts "File.exist?(fn_2)  #{File.exist?(fn_2)}"
  puts
  puts `ruby #{fn_1}`
  puts `ruby #{fn_2}`
end
```

produces the following output -

```
ENV['RUBYOPT']
filesystem     Windows-1252
external       IBM437
`chcp`         Active code page: 437
locale         IBM437
__ENCODING__   UTF-8
internal

fn_1           UTF-8
������.rb         UTF-8
fn_2           UTF-8
���������.rb       UTF-8

File.exist?(fn_1)  true
File.exist?(fn_2)  true

������.rb: No such file or directory @ realpath_rec - E:/temp/���������.rb (Errno::ENOENT)

ruby: Invalid argument -- ???.rb (LoadError)
```

Of note is that both files are created (and appear correctly in Explorer), but neither can be used as a script argument.

Copy and pasting the names (from Explorer) on the command line produces the following similar output -

```
E:\temp>ruby ������.rb
������.rb: No such file or directory @ realpath_rec - E:/temp/���������.rb (Errno::ENOENT)

E:\temp>ruby ���������.rb
ruby: Invalid argument -- ???.rb (LoadError)
```

Lastly, if before running the code I do a `chcp 1252` command to match up 'locale' and 'filesystem', the first script file runs and produces the correct output.

Hence, it appears that some (or all?) `File` methods deal properly with `filesystem` encoding, but ruby script arguments are not correctly encoded.



-- 
https://bugs.ruby-lang.org/

Unsubscribe: <mailto:ruby-core-request@ruby-lang.org?subject=unsubscribe>
<http://lists.ruby-lang.org/cgi-bin/mailman/options/ruby-core>