From: Daniel Schierbeck <daniel.schierbeck@...>
Date: 2005-11-28T21:52:29+09:00
Subject: Re: htmltokenizer bug?

Horacio Sanson wrote:
> I am using htmltokenizer to extract the links of some web pages, my script 
> worked perfectly until I started to parse pages with "<" and ">" chars in the 
> text.
> 
> a html string like this
> 
> <a href="an_uri" > this is a <link> </a>
> 
> causes the htmlparser to raise and exception; Error, tag is nil....
> 
> 
> Is there a patch or any way to make htmlparser to parse this text??
> 
> 
> regards,
> Horacio
> 
> 

Your HTML isn't valid. Either use the proper entities (< = &lt; and > = 
&gt;) or make a CDATA section, though the latter isn't really that 
well-supported in most browsers.

   <a href="an_uri"><![CDATA[this is a <link>]]></a>


Cheers,
Daniel