From: Intransition <transfire@...>
Date: 2010-12-07T00:33:04+09:00
Subject: Re: fairy: A framework for distributed processing



On Dec 6, 3:43 am, Hajime Masuda <hazi...@gmail.com> wrote:
> We are very happy to announce that fairy 0.6.0 has just been released!
>
> fairy is a framework for distributed processing in Ruby, originally
> designed at Rakuten Institute of Technology with Yukihiro Matsumoto,
> the founder of Ruby.
>
> Although fairy was inspired by MapReduce model, a well-known
> programming model for distributed processing, it's more flexible and
> suitable for wider use. That's due to fairy's programming model,
> called filter IF, and various built-in filters.
>
> fairy is implemented in Ruby and inherits its high productivity and
> simplicity. fairy's API is quite similar to Ruby. Therefore most
> programmers who know Ruby can easily understand and use it.
>
> Although fairy is still experimental, its basic functions work well.
>
> Please visit us and try it:
>  * <http://code.google.com/p/fairy-prj/>
>
> == Example: Distributed Word Count
>
> require 'rubygems'
> require 'fairy'
>
> fairy = Fairy::Fairy.new
> input = fairy.input "testdata.vf"
>
> maped = input.mapf(%{|ln|
>  ln.split
>
> })
>
> grouped = map.group_by(%{|w| w})
>
> counted = grouped.map(%q{|bag|
>  "#{bag.key}\t#{bag.size}"
>
> })
>
> counted.output "wc-out.txt"

Looks like the API could use Serializable Proc.