From: Steven Jenkins <steven.jenkins@...>
Date: 2005-11-06T08:42:03+09:00
Subject: Re: parser performance comparisions

Eric Mahurin wrote:
> The racc memory usage could also be helped if you don't
> generate the entire token stream in memory first. I'm not sure why there are
> no racc examples with low memory usage (don't read the entire file into a
> string and don't generate the entire token stream in memory up front).

Probably because for most applications it doesn't matter. But the 
example I sent you doesn't read the entire file into a string. It does 
load the entire token stream into an array, but that could easily be 
changed by running the lexer in a separate thread and using a SizedQueue 
for the token stream. Maybe a five-line change.

For this appliation, I really don't care about memory consumption. The 
largest file I'll ever parse is 100 times smaller than the physical 
memory on the machine, much less the available virtual memory.

Steve