From: Harry Kakueki <list.push@...>
Date: 2009-07-19T13:45:31+09:00
Subject: Re: Re-post: Parsing Japanese Language and Some Ruby Trivia

>
> There will be duplicates so perhaps each hiragana duple could be a
> variable? e.g. "暮ら+= 1" whenever a new instance of 暮ら is found. Would
> there be a more efficient way of counting the co-occurrences?
>
>

I guess I'm missing something.
It seems to me that you are trying to find groups of 2 or more
hiragana and calling each group a word.
But, many words contain no hiragana at all.
And a group of consecutive hiragana could be 1 word, 2 words, or
several words, or no word.
Some words are just 1 hiragana.

I don't know about the statistics you are working on. I guess you do.
Are you just interested in finding patterns without concern for the word status?

If I just stated the obvious, sorry for the noise.

Harry


-- 
A Look into Japanese Ruby List in English
http://www.kakueki.com/ruby/list.html