From: Kioko -- <mail_noxx@...>
Date: 2010-03-24T00:07:08+09:00
Subject: Converting file from utf-16 to utf-8

Hi,

I'm currently rewriting an old php-script in ruby.
One thing this script is for is to open a file which is in utf-16, read
it as utf-8, work a little bit with the data and save it into a
database.

However I tried to use Iconv to solve this but I've failed ;)

The php script runs perfectly without any error.
If somebody is familiar with php here is the code (yeah, very VERY ugly,
but that's why I'm rewriting it :))

$fp = fopen($file,"r");
$lines = file($file);
for ($line=1; $line<=count($lines); $line++) {
  $string .= fgets($fp);
}
$string = iconv('UTF-16', 'UTF-8', $string);


But Ruby throws an Iconv::IllegalSequence error:

doc = File.open(file).read
doc = Iconv.iconv('utf-16', 'utf-8', doc) #Iconv::IllegalSequence

Because it's the same file I really don't know how to solve this.
If I'm using utf-16//IGNORE, obviously, many signs are missing.
Are any other "workarounds"/methods to use out there?
Or something I overlooked?

sincerely.
-- 
Posted via http://www.ruby-forum.com/.