From: dseverin Date: 2006-01-10T03:11:03+09:00 Subject: Ruby, Unicode - ever? Well, as I could search the web so far, since about 2001 or even early, once in a while appears question: why ruby does not support Unicode??? Why can't ruby use at least ICU libs? (current state of UTF8 in Ruby, even with regexps, is too far away from proper Unicode support, don't try to cheat me, that it's OK and enough, it is not!) And usual answer is (for years!): m17n will be in Ruby 2.0 (Rite) as Unicode can't handle enough chars and Han unification is unacceptable. But... As for me, there are two big problems: 1. Ruby String class in current state is TOO MUCH OVERLOADED : it mixes byte-array and character-text string behaviour at the same time. That is definitely and absolutely wrong design decision. These are different paradigms, which must not be mixed ever. 2. My impession about rite m17n is that for each string it will be possible to set different encoding. I don't get it. As for byte array - encoding is senseless - this is plain bit stream. And for text - how will one compare/regexp/search using strings in different encodings??? (BTW, Unicode codepoint space is 10^21 - but do we really have over million of *different* characters?) What is the sense to create text-handling support code for all that multitude of encodings? (look in oniguruma - each encoding plugin sets own procedures and char properties to deal with multibyte encodings) Well, I think, String class must be REMOVED from Rite. Instead, two incompatible classes must be introduced: ByteArray and Text with well-separated semantics and behaviour. Else it will never end but eventually crash into crap ruins someday... -- Posted via http://www.ruby-forum.com/.