From: Trans <transfire@...>
Date: 2007-07-23T22:45:21+09:00
Subject: Re: Processing a huge xml file



On Jul 23, 4:28 am, Tim Perrett <freestyle_kaya...@hotmail.com> wrote:
> Hey guys
>
> I was wondering what advice anyone could possibly hand me about
> processing a huge XML (in fact its an XSD file)
>
> Overall, its about 20,000 lines of XML to load. Even on my macbook pro
> with 2GB of RAM, libxml-ruby eats it up extremely quickly (and about 2.8
> GB of virtual memory). This is obviously unacceptable, but I am not sure
> that a work around exists?
>
> I wanted to load in the schema in order to validate the messages and xml
> I was generating. Has anyone any ideas on a potential work around?

libxml has some know issues, memory consumption especially. Hopefully
they will get fixed, but in the mean time one can only frown at the
irony -- <rubyXML> was one of the earliest Ruby web sites around, yet
Ruby's support of _fast_ XML processing is still dearly lacking.

T.