From: Robert Klemme <shortcutter@...>
Date: 2007-07-27T15:19:07+09:00
Subject: Re: Processing a huge xml file

2007/7/27, Tim Perrett <freestyle_kayaker@hotmail.com>:
> The file in question is actually an XSD file, so I think your right,
> XML::Schema.new() would use DOM parsing. Does lixml even suport stream
> parsing? I cant seem to find a great deal on it...
>
> Has anyone ever had any experience with such a large XSD? I cant think
> there would be a way of validating the instance xml without the XSD
> being held in memory to then check against?

Yes and no: since the XML (XSD in your case) is known the parser could
store an optimized representation in memory (i.e. does not need the
original DOM).

> How do things like xerces manage it with java?

When a colleague testes JDom few years ago, it needed loads of mem.
But of course, that could have changed by now (and also, there's 64
bit JVMs).

> I fear i might be wanting the imposible! lol

"Impossible is nothing - Ruby..." :-)

Kind regards

robert