From: "John W. Long" <ng@...>
Date: 2004-01-11T14:34:27+09:00
Subject: Re: Converting a string to an array of tokens

Hal Fulton wrote:
> irb comes with its own lexer. I've used that before.
> (If it's Ruby you're tokenizing.)

Actually no, I'm not using it to parse Ruby. I'm just looking for something
general that works like String#scan, but leaves the tokens in place in the
array. This would be useful for parsing almost any language.
___________________
John Long
www.wiseheartdesign.com