From: botp <botpena@...>
Date: 2010-12-11T17:52:33+09:00
Subject: Re: ruby unicode/string explosion (0xFF in utf-8)

On Sat, Dec 11, 2010 at 12:40 PM, Sylvester T Cat
<sylvestertcat1@gmail.com> wrote:
> Is there any way to strip out these characters while staying with
> utf-8 encoding?

see http://blog.grayproductions.net/articles/encoding_conversion_with_iconv

eg,

require 'iconv'
#=> true
a="abcde \xFF ghi"
#=> "abcde \xFF ghi"
a.encoding
#=> #<Encoding:UTF-8>
ic = Iconv.new 'UTF-8//IGNORE', 'UTF-8'
#=> #<Iconv:0x944f468>
ic.iconv a
#=> "abcde  ghi"

kind regards -botp