From: Hajime Masuda <hazimem@...>
Date: 2010-12-06T17:43:33+09:00
Subject: [ANN] fairy: A framework for distributed processing

We are very happy to announce that fairy 0.6.0 has just been released!

fairy is a framework for distributed processing in Ruby, originally
designed at Rakuten Institute of Technology with Yukihiro Matsumoto,
the founder of Ruby.

Although fairy was inspired by MapReduce model, a well-known
programming model for distributed processing, it's more flexible and
suitable for wider use. That's due to fairy's programming model,
called filter IF, and various built-in filters.

fairy is implemented in Ruby and inherits its high productivity and
simplicity. fairy's API is quite similar to Ruby. Therefore most
programmers who know Ruby can easily understand and use it.

Although fairy is still experimental, its basic functions work well.

Please visit us and try it:
 * <http://code.google.com/p/fairy-prj/>


== Example: Distributed Word Count


require 'rubygems'
require 'fairy'

fairy = Fairy::Fairy.new
input = fairy.input "testdata.vf"

maped = input.mapf(%{|ln|
 ln.split
})

grouped = map.group_by(%{|w| w})

counted = grouped.map(%q{|bag|
 "#{bag.key}\t#{bag.size}"
})

counted.output "wc-out.txt"


Enjoy!


-- 
Hajime Masuda
Rakuten Institute of Technology Rakuten, Inc.
email: hajime.masuda@mail.rakuten.co.jp