From: "Ara.T.Howard" <ahoward@...>
Date: 2004-08-17T10:31:00+09:00
Subject: Re: [ANN] ruby queue : rq-0.1.2

On Mon, 16 Aug 2004, Shashank Date wrote:

> Hi Ara,
>
> "Ara.T.Howard" <ahoward@noaa.gov> wrote in message
>> this has not been tested on any window machines.
>>
>> our environment is 100% linux - latest enterprise kernel on all boxes,
>> including nfs servers.  the code SHOULD work on any box for which nfs
> locking
>> works (both my code and sqlite depend on fcntl locks working).  if you are
>> interested in trying it out please let me know and i'll help you get a
> test
>> system up.
>
> Definitely interested, but unfortunately won't be able to devote testing
> time until early November (if at all). I am looking at a project in the pipe
> which may have a mix of Linux and Windows for which this would be just
> perfect.

you'll probably want to test you nfs setup first - i can give a little script
that should determine if mixed windows/linux nfs access works with locking -
it's pure ruby so it should just run.  do you have a few nodes you can test
on?

>
> If and when we start using it, I will be able to contribute towards:

> 0. GUI Console,

that'd be great - it's on the TODO list...

> 1. dynamic load-balancer

it doesn't need one! ;-)  all nodes access the queue taking jobs in a 'highest
priority oldest out first' fashion.  in otherwords, all nodes bail water as
fast as possible - if the boat is sinking the only answers are:

   - write faster jobs
   - make network faster (vsftp is great!)
   - buy faster nodes
   - buy more nodes

this is one of the great things about the totally decentralized architechture
- there is no need for load balancing or scheduling!

> 2. rudimentary work-flow engine

you mean dependancies?  yes that would be nice...

> in that order....if it does not have these by then, that is.
>
> Wish you the very best.
> -- shanko

it all sounds great - i'll try to get some more docs out in the next few weeks
so you can read about it.

cheers.

-a
--
===============================================================================
| EMAIL   :: Ara [dot] T [dot] Howard [at] noaa [dot] gov
| PHONE   :: 303.497.6469
| A flower falls, even though we love it;
| and a weed grows, even though we do not love it. 
|   --Dogen
===============================================================================