From: Samuel Williams <space.ship.traveller@...>
Date: 2012-06-12T01:48:39+09:00
Subject: Re: Is resolv.rb broken in 1.9.3 due to encodings?

--90e6ba5bbba103f87404c2351f19
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Okay, so I just did a bit more testing and found that at least I get an
error. When I try to encode a IN::TXT record that includes UTF-8 Japanese
characters, I get the following error:

Encoding::CompatibilityError: incompatible character encodings: ASCII-8BIT
and UTF-8

I can't see why this is happening though because the initial @data =3D '' =
=96
shouldn't that use the default encoding (UTF-8)?

Finally, I am happy to pack UTF-8 data into the IN::TXT, but it doesn't
seem that this is possible using IN::TXT as it currently stands =96 is ther=
e
some way to consider the UTF-8 string as ASCII-8BIT for binary data
purposes?

Kind regards,
Samuel

On 12 June 2012 04:28, Samuel Williams <space.ship.traveller@gmail.com>wrot=
e:

> Hi,
>
> I'm trying to work through some issues using 1.9.3 for my project RubyDNS=
,
> and I noticed the following code in resolv.rb's MessageEncoder:
>
>       class MessageEncoder # :nodoc:
>         def initialize
>           @data =3D ''
>           @names =3D {}
>           yield self
>         end
>
>         def to_s
>           return @data
>         end
>
>         def put_bytes(d)
>           @data << d
>         end
>
>         def put_pack(template, *d)
>           @data << d.pack(template)
>         end
>
>         def put_length16
>           length_index =3D *@data.length*
>           @data << "\0\0"
>           data_start =3D *@data.length*
>           yield
>           data_end =3D *@data.length*
> *          @data[length_index, 2] =3D [data_end - data_start].pack("n")*
>         end
>
> I'm just wondering, shouldn't this be using byteslice, bytesize and
> friends? Isn't this code completely broken by default since we use UTF-8
> encoding? Am I missing something?
>
> Kind regards,
> Samuel
>

--90e6ba5bbba103f87404c2351f19
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Okay, so I just did a bit more testing and found that at least I get an err=
or. When I try to encode a IN::TXT record that includes UTF-8 Japanese char=
acters, I get the following error:<div><br></div><div>Encoding::Compatibili=
tyError: incompatible character encodings: ASCII-8BIT and UTF-8<br>
<br></div><div>I can&#39;t see why this is happening though because the ini=
tial @data =3D &#39;&#39; =96 shouldn&#39;t that use the default encoding (=
UTF-8)?</div><div><br></div><div>Finally, I am happy to pack UTF-8 data int=
o the IN::TXT, but it doesn&#39;t seem that this is possible using IN::TXT =
as it currently stands =96 is there some way to consider the UTF-8 string a=
s ASCII-8BIT for binary data purposes?</div>
<div><br></div><div>Kind regards,</div><div>Samuel</div><div><br><div class=
=3D"gmail_quote">On 12 June 2012 04:28, Samuel Williams <span dir=3D"ltr">&=
lt;<a href=3D"mailto:space.ship.traveller@gmail.com" target=3D"_blank">spac=
e.ship.traveller@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div class=3D"HOEnZb"><div class=3D"h5">Hi,<=
div><br></div><div>I&#39;m trying to work through some issues using 1.9.3 f=
or my project RubyDNS, and I noticed the following code in resolv.rb&#39;s =
MessageEncoder:</div>
<div><br></div><div><div>=A0 =A0 =A0 class MessageEncoder # :nodoc:</div>
<div>=A0 =A0 =A0 =A0 def initialize</div><div>=A0 =A0 =A0 =A0 =A0 @data =3D=
 &#39;&#39;</div><div>=A0 =A0 =A0 =A0 =A0 @names =3D {}</div><div>=A0 =A0 =
=A0 =A0 =A0 yield self</div><div>=A0 =A0 =A0 =A0 end</div><div><br></div><d=
iv>=A0 =A0 =A0 =A0 def to_s</div><div>=A0 =A0 =A0 =A0 =A0 return @data</div=
>

<div>=A0 =A0 =A0 =A0 end</div><div><br></div><div>=A0 =A0 =A0 =A0 def put_b=
ytes(d)</div><div>=A0 =A0 =A0 =A0 =A0 @data &lt;&lt; d</div><div>=A0 =A0 =
=A0 =A0 end</div><div><br></div><div>=A0 =A0 =A0 =A0 def put_pack(template,=
 *d)</div><div>=A0 =A0 =A0 =A0 =A0 @data &lt;&lt; d.pack(template)</div>

<div>=A0 =A0 =A0 =A0 end</div><div><br></div><div>=A0 =A0 =A0 =A0 def put_l=
ength16</div><div>=A0 =A0 =A0 =A0 =A0 length_index =3D <b>@data.length</b><=
/div><div>=A0 =A0 =A0 =A0 =A0 @data &lt;&lt; &quot;\0\0&quot;</div><div>=A0=
 =A0 =A0 =A0 =A0 data_start =3D <b>@data.length</b></div>

<div>=A0 =A0 =A0 =A0 =A0 yield</div><div>=A0 =A0 =A0 =A0 =A0 data_end =3D <=
b>@data.length</b></div><div><b>=A0 =A0 =A0 =A0 =A0 @data[length_index, 2] =
=3D [data_end - data_start].pack(&quot;n&quot;)</b></div><div>=A0 =A0 =A0 =
=A0 end</div></div><div><br></div><div>

I&#39;m just wondering, shouldn&#39;t this be using byteslice, bytesize and=
 friends? Isn&#39;t this code completely broken by default since we use UTF=
-8 encoding? Am I missing something?</div><div><br></div><div>Kind regards,=
</div>

<div>Samuel</div>
</div></div></blockquote></div><br></div>

--90e6ba5bbba103f87404c2351f19--