From: Yui NARUSE Date: 2010-11-22T18:34:56+09:00 Subject: [ruby-core:33284] [Ruby 1.9-Feature#4073] HKSCS-2008 Issue #4073 has been updated by Yui NARUSE. Current Ruby's table doesn't have one way conversion, it is wrong. So I imported tables from ICU. Now following will pass in trunk. ./ruby -e'p ["A15AA1C3A1C5A1FEA240A2CCA2CEA3E1"].pack("H*").encode("utf-8","cp951")' ./ruby -e'p ["F9E9F9EAF9EBF9F9F9FAF9FBF9FCF9FD"].pack("H*").encode("utf-8","big5-hkscs")' > HKSCS is just a supplementary set of Big5, but they didn't finger out which kind of Big5 base on. Consider for compatibility, I think CP951 is a good choice. Also, HKSCS-2008 ([2]) was released for a long time. So I tried to combine CP951 and HKSCS-2008 together to make a new tbl file, but I met some problems. For interoperability, we consider compatibility to another implementations. So can you propose HKSCS-2008 support to GNU libiconv? We want to follow them. > First, HKSCS-2008 included 3 ligatures: > Then, these mappings were included in CP951: See enc/trans/. 1:N conversion is specified by simply bytes to bytes mapping. To specify fallback mapping, split tables from UCS and to UCS. Anyway we can import simple ucm file, so use it. http://userguide.icu-project.org/conversion/data ---------------------------------------- http://redmine.ruby-lang.org/issues/show/4073 ---------------------------------------- http://redmine.ruby-lang.org