From: Travis Whitton <whitton@...>
Date: 2003-02-20T14:34:17+09:00
Subject: Re: optimization question

> Since I've lost the original email, I'll just say that I there's a
> more efficient way to do what you're doing.  Keep a real database of
> tokens, and use mail to update it, rather than re-tokenizing the whole
> email set.

This is a good idea, and it looks like an interesting project. Does it allow
you to create a database file from already existing corpus files, or does it
require you to start from scratch? I've spent a good amount of time building
up the 2000 some-odd messages I'm currently using to gather my statistics,
and I'd hate to have two huge corpus files wasted. Also, the main reason I
started this project was to learn, so I'd still like to find a fast way to
update a hash key without having to access it twice.
 
Thanks,
Travis