From: "duerst (Martin Dürst)" Date: 2012-03-23T15:17:29+09:00 Subject: [ruby-core:43571] [ruby-trunk - Bug #6190] String#encode return string containing invalid chars but marked as valid Issue #6190 has been updated by duerst (Martin D��rst). Description updated pplr (Pierre PLR) wrote: > >> a = " \xE9 ".encode('UTF-8', 'UTF-8', :invalid => :replace, :replace => "?") > >> a.valid_encoding? > => true Nobu fixed this so it won't return true anymore, which would be a lie. > >> a > => " \xE9 " > The expected string is " ? ", as the documentation for the ":replace" options says : > If the value is :replace, encode replaces invalid byte sequences in str with the replacement character. I added documentation to say that encoding from encoding A to the same encoding A is a no-op. Changing this would not be impossible, but would involve quite some work, and would make these operations slower. ---------------------------------------- Bug #6190: String#encode return string containing invalid chars but marked as valid https://bugs.ruby-lang.org/issues/6190#change-25066 Author: pplr (Pierre PLR) Status: Closed Priority: Normal Assignee: Category: Target version: ruby -v: ruby 1.9.2p290 (2011-07-09 revision 32553) [i686-linux] >> a = " \xE9 ".encode('UTF-8', 'UTF-8', :invalid => :replace, :replace => "?") >> a.valid_encoding? => true >> a => " \xE9 " >> a.squeeze ArgumentError: invalid byte sequence in UTF-8 from (irb):32:in `squeeze' from (irb):32 from /usr/bin/irb:12:in `
' The expected string is " ? ", as the documentation for the ":replace" options says : If the value is :replace, encode replaces invalid byte sequences in str with the replacement character. -- http://bugs.ruby-lang.org/