[zeromq-dev] Open source data plant project

[Pieter Hintjens]

On Thu, Feb 24, 2011 at 3:01 PM, Michiel ten Hagen <michiel at klaproos.net> wrote:

> My current project is a distributed ' latest value'  system where 'items'
> have several key/value pairs on which updates are received. Several
> architectural principles are the same as described in your whale
> shark system, I will follow closely and if possible might contribute.

There's a much less ambitious design for a distributed key-value system here:

http://zguide.zeromq.org/chapter:all#toc69

> Is the goal to provide a base layer on which distributed stream processing
> can be done or will be a complete processing system such as boreals
>  http://www.cs.brown.edu/research/borealis/public/?

It's a framework into which you plug your own applications.

> A base framework like 'whaleshark' could be beneficial if it does not impose
> too many restrictions on the applications on top.

See the API discussion, at the end of the whitepaper. It's very simple in fact.

-Pieter