From: Stanley Xu <wenhao.xu@...>
Date: 2011-03-22T23:30:43+09:00
Subject: Re: How could I make the Ruby 1.9 string ignore the invalid utf-8 byte sequence in split?

--bcaec52e6017c78983049f13160c
Content-Type: text/plain; charset=ISO-8859-1

Sorry, I just mis-sent the half-typed mail by a short-cut in gmail.

I just resent a mail to described the problem.

Best wishes,
Stanley Xu



On Tue, Mar 22, 2011 at 10:27 PM, Stanley Xu <wenhao.xu@gmail.com> wrote:

> Dear buddies,
>
> I am using ruby to run some map reduce job in hadoop streaming.
> Unfortunately, we have some dirty data which have invalid byte sequence as
> the input. So while running things like
>
> line.chomp.split("\t")
>
> I will get
>
> Best wishes,
> Stanley Xu
>

--bcaec52e6017c78983049f13160c--