[ruby-core:33030] Re: [Ruby 1.9-Bug#4010] YAML fails to roundtrip non ASCII String

2010/11/3 Aaron Patterson <[e-mail]>:
> On Tue, Nov 02, 2010 at 09:58:27PM +0900, Heesob Park wrote:
>> Issue #4010 has been updated by Heesob Park.
>>
>>
>> The same result with psych.
>>
>> $ ruby -v -ryaml -e 'YAML::ENGINE.yamler = "psych"; s="한글";pYAML.load(YAML.dump(s))==s'
>> ruby 1.9.3dev (2010-11-02 trunk 29667) [i686-linux]
>> /usr/local/lib/ruby/1.9.1/psych/deprecated.rb:79: warning: method redefined; discarding old to_yaml_properties
>> /usr/local/lib/ruby/1.9.1/syck/rubytypes.rb:13: warning: previous definition of to_yaml_properties was here
>> false
>>
>> FYI the current encoding is 'EUC-KR'.
>> I know it works when the encoding is 'UTF-8'.
>
> I think the problem is that your default_internal encoding isn't being
> set.  YAML is usually stored as UTF-8, but psych will automatically
> transcode the string to whatever your default_internal encoding is set
> to.
>
> Maybe this script will help illustrate the problem:
>
>
>    # coding: utf-8
>
>    require 'psych'
>
>    eucjp = "こんにちは！".encode('EUC-JP')
>    string = Psych.load(Psych.dump(eucjp))
>
>    p string.encoding # => #<Encoding:UTF-8>
>    p eucjp == string # => false
>
>    Encoding.default_internal = 'EUC-JP'
>
>    string = Psych.load(Psych.dump(eucjp))
>    p string.encoding # => #<Encoding:EUC-JP>
>    p eucjp == string # => true
>
> Try running your Ruby like this:
>
>  $ ruby -EEUC-KR:EUC-KR -v -ryaml -e 'YAML::ENGINE.yamler = "psych"; s="한글";pYAML.load(YAML.dump(s))==s'
Here is the result

$ ruby -EEUC-KR:EUC-KR -v -ryaml -e 'YAML::ENGINE.yamler = "psych";
s="한글";p YAML.load(YAML.dump(s))==s'
ruby 1.9.3dev (2010-11-02 trunk 29667) [i686-linux]
true

Did you mean it is not a bug and I must specify the default external
and internal character encodings?

$ irb
irb(main):001:0> Encoding.default_external
=> #<Encoding:EUC-KR>
irb(main):002:0> Encoding.default_internal
=> nil
Why ruby cannot detect Encoding.default_internal ?


Regards,
Park Heesob