ruby-dev

成瀬です。

手元の環境を眺めつつ、色々と replica や alias を設定してみました。現在指
定可能なエンコーディングは以下のとおりです。ISO 8859 シリーズはとりあえ
ずそれっぽいのの replica にしているので間違っていたら教えてください。
（Windows-1251 は なんか間違えた気がする・・・）
"ASCII" is original encoding
"EUC-JP" is original encoding
"ISO-8859-1" is original encoding
"ISO-8859-10" is original encoding
"ISO-8859-11" is original encoding
"ISO-8859-13" is original encoding
"ISO-8859-14" is original encoding
"ISO-8859-15" is original encoding
"ISO-8859-16" is original encoding
"ISO-8859-2" is original encoding
"ISO-8859-3" is original encoding
"ISO-8859-4" is original encoding
"ISO-8859-5" is original encoding
"ISO-8859-6" is original encoding
"ISO-8859-7" is original encoding
"ISO-8859-8" is original encoding
"ISO-8859-9" is original encoding
"Shift_JIS" is original encoding
"US-ASCII" is original encoding
"UTF-8" is original encoding
"UTF-16BE" is original encoding
"UTF-16LE" is original encoding
"UTF-32BE" is original encoding
"UTF-32LE" is original encoding
""Windows-1255" is replica of "ISO-8859-8"
"Windows-1256" is replica of "ISO-8859-6"
"Windows-1257" is replica of "ISO-8859-4"
"Windows-874" is replica of "ISO-8859-11"
"CP51932" is replica of "EUC-JP"
"eucJP-ms" is replica of "EUC-JP"
"Windows-31J" is replica of "Shift_JIS"
"Windows-1251" is replica of "ISO-8859-5"
"Windowws-1250" is replica of "ISO-8859-2"
"Windows-1252" is replica of "ISO-8859-1"
"Windows-1253" is replica of "ISO-8859-7"
"Windows-1254" is replica of "ISO-8859-9"
"CP932" is alias of "Windows-31J"
"ISO8859-6" is alias of "ISO-8859-6"
"ISO8859-14" is alias of "ISO-8859-14"
"CP1252" is alias of "Windows-1252"
"SJIS" is alias of "Shift_JIS"
"CP1253" is alias of "Windows-1253"
"ISO8859-7" is alias of "ISO-8859-7"
"ISO8859-15" is alias of "ISO-8859-15"
"BINARY" is alias of "ASCII-8BIT"
"646" is alias of "US-ASCII"
"CP1254" is alias of "Windows-1254"
"ISO8859-8" is alias of "ISO-8859-8"
"ISO8859-16" is alias of "ISO-8859-16"
"ISO8859-9" is alias of "ISO-8859-9"
"CP1255" is alias of "Windows-1255"
"eucJP" is alias of "EUC-JP"
"ANSI_X3.4-1986" is alias of "US-ASCII"
"CP1256" is alias of "Windows-1256"
"CP1257" is alias of "Windows-1257"
"ASCII" is alias of "US-ASCII"
"ISO8859-1" is alias of "ISO-8859-1"
"csWindows31J" is alias of "Windows-31J"
"ISO8859-2" is alias of "ISO-8859-2"
"ISO8859-10" is alias of "ISO-8859-10"
"ISO8859-3" is alias of "ISO-8859-3"
"CP874" is alias of "ISO-8859-11"
"ISO8859-11" is alias of "ISO-8859-11"
"euc-jp-ms" is alias of "EUC-JP"
"ISO8859-4" is alias of "ISO-8859-4"
"CP1250" is alias of "Windows-1250"
"CP1251" is alias of "Windows-1251"
"ISO8859-5" is alias of "ISO-8859-5"
"ISO8859-13" is alias of "ISO-8859-13"

未登録なもののうち、鬼車がサポートしているのは、以下の通り。
bg_BG.CP1251   Bulgarian Cyrillic character set (CP1251), CODESET=CP1251
ko_KR.eucKR    1 0x0000 2 0x8080 2 0x0080 3 0x8000 0x8080 CODESET=eucKR
ru_RU.KOI8-R   Russian CODESET=KOI8-R
zh_CN.GB18030  CODESET=GB18030
zh_CN.eucCN    1 0x0000 2 0x8080 2 0x0080 3 0x8000 0x8080 CODESET=eucCN
zh_TW.BIG5     CODESET=BIG5
zh_TW.eucTW    CODESET=eucTW

KOI8-U は KOI8 の replica なのか別物なのかがわかりませんでした。なにか影
響あるのかな。
uk_UA.KOI8-U   Ukrainian CODESET=KOI8-U character set

あと以下のエンコーディングがありましたが、これはサポートする必要あるので
すかね？なんかなさそう。
ru_RU.CP866      Russian Alternative charset, CODESET=CP866
kk_KZ.PT154      PT154 character set,CODESET=PT154
hy_AM.ARMSCII-8  Armenian ARMSCII-8 character set, CODESET=ARMSCII-8
ru_RU.CP866      Russian Alternative charset, CODESET=CP866


ところで、現在 rb_locale_encoding は locale_charmap が nil だと
ASCII-8BIT を返しますが、POSIX 的にいえば nil = C なわけで、US-ASCII を
返すのはどうでしょう。また、未登録の名前が来たときは dummy を返しませんか。

Index: encoding.c
===================================================================
--- encoding.c  (revision 15025)
+++ encoding.c  (working copy)
@@ -872,13 +872,14 @@ rb_locale_encoding(void)
 {
     VALUE charmap = rb_locale_charmap(rb_cEncoding);
     int idx;
+    char *name;

-    if (NIL_P(charmap))
-        return rb_ascii8bit_encoding();
+    if (NIL_P(charmap)) name = "US-ASCII";
+    else name = StringValueCStr(charmap)

-    idx = rb_enc_find_index(StringValueCStr(charmap));
+    idx = rb_enc_find_index(name);
     if (idx < 0)
-        return rb_ascii8bit_encoding();
+        idx = rb_define_dummy_encoding(name);

     return rb_enc_from_index(idx);
 }

-- 
NARUSE, Yui  <naruse@airemix.com>
DBDB A476 FDBD 9450 02CD 0EFC BCE3 C388 472E C1EA

Thread

Prev Next

In This Thread

Prev Next

[#32910] NKF,Kconv — Kazuhiro NISHIYAMA <zn@...>

[#32913] openの"b"とencoding — Kazuhiro NISHIYAMA <zn@...>

[#32922] SEGV by regexp match in while loop — Tanaka Akira <akr@...>

[#32932] extend Tempfile — Tanaka Akira <akr@...>

[#32935] queue and timeout — Tanaka Akira <akr@...>

[#32940] ripper cannot build on win32 — yukimi_sake <yukimi_sake@...>

[#32945] Shift_JIS variants and UTF-16 support — "U.Nakamura" <usa@...>

[#32946] replica と alias の違い(encoding) — KIMURA Koichi <kimura.koichi@...>

[#32957] SEGV by Symbol#match — "Hiroyuki Iwatsuki" <don@...>

[#32970] rb_thread_create()の中でmodule_eval — Kouhei Sutou <kou@...>

[#32979] BOM of UTF-８ — KIMURA Koichi <hogemuta@...>

[#32987] error with open-uri (instance_eval?) — "U.Nakamura" <usa@...>

[#32988] Re: [ruby-cvs:22194] Ruby:r14957 (trunk): * encoding.c (rb_enc_init): UTF-{16,32}{BE,LE} are not builtin. — Yukihiro Matsumoto <matz@...>

[#32992] ASCII is alias of US-ASCII; replica of dummy encoding is not a dummy — "NARUSE, Yui" <naruse@...>

[#32996] binmode and ASCII-8BIT — Kazuhiro NISHIYAMA <zn@...>

[#33058] Time.mktime — Tadayoshi Funaba <tadf@...>

[#33059] time.rb — Tadayoshi Funaba <tadf@...>

[#33060] Shellwords alias bug? — Masahiro Kawato <m-kawato@...>

[#33061] rational 1.18 — Tadayoshi Funaba <tadf@...>

[#33069] Re: [ruby-cvs:22244] Ruby:r15007 (trunk): * enc/make_encdb.rb: added. search enc/*.c and make encoding database. — Yukihiro Matsumoto <matz@...>

[#33072] Segmentation fault when File.open — Jun Mukai <mukai@...>

[#33076] Encoding.compatible? and dummy encodings — sheepman <sheepman@...>

[#33078] NEW REPLICA ENCODINGS AND ENCODING ALIASES — "NARUSE, Yui" <naruse@...>

[#33079] A patch for the manpage and ruby -h — Yugui <yugui@...>

[#33088] IO#gets with limit — sheepman <sheepman@...>

[#33095] Coerce via aliased methods — Yugui <yugui@...>

[#33097] Re: [ruby-cvs:22286] Ruby:r15049 (trunk): * configure.in (setup): add -I$(EXTOUT)/$(arch) to MINIRUBY. — "U.Nakamura" <usa@...>

[#33101] String#valid_encoding? shoud be strict? — Masayoshi Takahashi <maki@...>

[#33111] us_ascii.o: No such file or directory — Martin Duerst <duerst@...>

[#33124] Thread#priority= does not work — "Yusuke ENDOH" <mame@...>

[#33129] uninitialized constant Encoding::ASCII_8BIT (NameError) — Tanaka Akira <akr@...>

[#33130] 1.9.0 をコンパイルしてみた — Shin-ichiro HARA <sinara@...>

[#33136] enc_register_at should use strdup — sheepman <sheepman@...>

[#33139] Bignum#* might invoke GC parallelly? — "Yusuke ENDOH" <mame@...>

[#33142] eval(str.dump)==str — Kazuhiro NISHIYAMA <zn@...>

[#33156] default script encoding and -K option — sheepman <sheepman@...>

[#33159] the encoding of StringIO.new — sheepman <sheepman@...>

[#33164] default encoding for Marshal.load — "Shugo Maeda" <shugo@...>

[#33173] should initialize the group of threads — sheepman <sheepman@...>

[#33185] コンパイルの問題 (r15218) — Martin Duerst <duerst@...>

[#33189] nonlinear performance of each_char — Tanaka Akira <akr@...>

[#33191] Re: [ruby-cvs:22367] Ruby:r15130 (trunk): * enc/koi8_u.c: added. — Tanaka Akira <akr@...>

[#33211] each_char — Tanaka Akira <akr@...>

[#33218] Re: Ruby1.9String バイト列へのインデックス アクセス — "Hisanori Kiryu" <hkiryu@...>

[#33221] encoding of Iconv::Failure#success — Tanaka Akira <akr@...>

[#33224] printf "%0x" — Tanaka Akira <akr@...>

[#33226] [PATCH] warnings of enc/trans/utf_16_32.c — Nobuyoshi Nakada <nobu@...>

[#33231] each_char yields extra NUL — Tanaka Akira <akr@...>

[#33234] SEGV by test/ruby/test_io_m17n.rb — Tanaka Akira <akr@...>

[#33239] Re: [ruby-cvs:22386] Ruby:r15149 (trunk): * string.c (rb_str_each_char): move forward. — Tanaka Akira <akr@...>

[#33247] requests to transcode — "U.Nakamura" <usa@...>

[#33257] Bignum#quo may cause infinite loop — "Yusuke ENDOH" <mame@...>

[#33258] exhaustive test for bignum.c — "Yusuke ENDOH" <mame@...>

[#33261] Local variables in ChangeLog — Kazuhiro NISHIYAMA <zn@...>

[#33264] Marshal.load fails on LANG=ja_JP.EUC-JP — Tanaka Akira <akr@...>

[#33265] backported GC.stress for 1.8 — Tadashi Saito <shiba@...2.accsnet.ne.jp>

[#33273] Re: [ruby-cvs:22404] Ruby:r15167 (trunk): * configure.in (MINIRUBY): remove -I$(EXTOUT)/$(arch) from — Tanaka Akira <akr@...>

[#33275] comment about sprintf %u — "Yusuke ENDOH" <mame@...>

[#33276] comment about Math#asin — "Yusuke ENDOH" <mame@...>

[#33279] ASCII-8BIT regexp — sheepman <sheepman@...>

[#33280] exhaustive tests for struct.c, sprintf.c and math.c — "Yusuke ENDOH" <mame@...>

[#33282] fronzen string cannot unpack("p") — Nobuyoshi Nakada <nobu@...>

[#33303] Time#strftimeのエンコーディング — rubikitch@...

[#33328] can modify array during iteration — "Yusuke ENDOH" <mame@...>

[#33340] Can large scale projects be successful implemented around a dynamic programming language? — Jordi <mumismo@...>

[#33354] Re: [ruby-cvs:22447] Ruby:r15210 (trunk): * io.c (rb_io_getline_fast): the end point of left_char_head() — "U.Nakamura" <usa@...>

[#33359] printf "%#o\n", 0 — Tanaka Akira <akr@...>

[#33363] printf "%.0d\n", 0 — Tanaka Akira <akr@...>

[#33364] rdocのメモリ消費量がやばい — rubikitch@...

[#33367] printf "%#o\n", -1 — Tanaka Akira <akr@...>

[#33368] summary of script encoding — "U.Nakamura" <usa@...>

[#33377] Regexp#sourceのencoding — Kazuhiro NISHIYAMA <zn@...>

[#33380] Re: [ruby-cvs:22481] Ruby:r15244 (trunk): * string.c (rb_str_usascii_new{,2}: defined. — Tanaka Akira <akr@...>

[#33387] HashからStructを作る — rubikitch@...

[#33388] void value expression — SASADA Koichi <ko1@...>

[#33392] Re: [ruby-cvs:22482] Ruby:r15245 (trunk): * compile.c, compile.h: fix stack pointer issues. — Tanaka Akira <akr@...>

[#33399] regexp match /.../n against to UTF-8 string — Tanaka Akira <akr@...>

[#33400] /#{}/e.encoding — Tanaka Akira <akr@...>

[#33401] _dump and encoding with marshal — Tanaka Akira <akr@...>

[#33403] wrapped String#gsub — "Park Ji-In" <tisphie@...>

[#33218] Re: Ruby1.9String 　バイト列へのインデックス　アクセス — "Hisanori Kiryu" <hkiryu@...>