From: Bob Hutchison <hutch@...>
Date: 2008-01-13T12:49:51+09:00
Subject: Re: Stream Parsing with REXML

Hi Marc and Dusty,

On 12-Jan-08, at 1:55 PM, dusty wrote:

> I have found that hpricot works very well with large xml files.  It
> streams it automatically.  I use it to parse a 5M xml file and it does
> it rather quickly.

Dusty, you sure hpricot is streaming?

At any rate, it is a lot faster than any pure Ruby XML parser. Marc,  
if performance is your only problem hpricot is worth looking at. It'll  
only take a few seconds to know, it's something like 4 lines of Ruby  
to find out:

require 'rubygems'
require 'hpricot'

doc = open(<your file name here>) do |f|
   Hpricot.XML(f)
end

If that works well enough you're probably set. Hpricot's search and  
query stuff is pretty nice.

If you still have problems, let us know. If you really need streaming  
you have a few options.

>
>
> http://code.whytheluckystiff.net/doc/hpricot/
> http://code.whytheluckystiff.net/hpricot/
>


Cheers,
Bob

----
Bob Hutchison                  -- tumblelog at http://www.recursive.ca/so/
Recursive Design Inc.          -- weblog at http://www.recursive.ca/hutch
http://www.recursive.ca/       -- works on http://www.raconteur.info/cms-for-static-content/home/