[zeromq-dev] Distributed pipes

[Michel Pelletier]

On Thu, Apr 24, 2014 at 1:40 PM, Pieter Hintjens <ph at imatix.com> wrote:

> On Thu, Apr 24, 2014 at 10:32 PM, Michel Pelletier
> <pelletier.michel at gmail.com> wrote:
> > I haven't used it, but ZeroVM looks pretty cool, process containers in
> > general are getting a lot of press lately.  I can see how a distributed
> pipe
> > system would give them a nice simple tool on top to interconnect
> sandboxed
> > processes in a controlled way.  Is there some issue or proposal they are
> > working on?
>
> We're doing this step by step. I'm not sure ZeroVM is using zpipes
> yet... soon though.


Another, perhaps related tool is zerorpc, which is done by the docker
people (another process container).  It's more RPC that pipes, but does
support a notion of streaming responses.  A pipe model could probably be
built on top.


> > I put some thought into but didn't spike any code on an evolution of the
> > nerve idea.  I've been informally calling them zerodog and zerocat.
>
> Oh dear, Cutism... I've been so guilty of that too. I've learned that
> inventing concepts is often a sign of failure rather than success. :)
> The dog/cat model does sound much like distributed pipes.
>

Yeah hence the informality.  I tried to minimize the inventiveness,
"watchdog" is a common term for a process watching another process, and
"cat" is as old as unix itself, just trying to reuse these well established
patterns in a new way perhaps.  I'm never one to give much of a damn about
names.


> > There's an interesting pattern here, distributed management of not only
> > processes but also the streams of data they produce.  Food for thought.
>
> One thing we lack in ZeroMQ generally is resilience, supervisor trees and
> such.
>

Yep, lifting some of those notions right out of erlang would probably be
very useful to us.  This article was helpful for me while i was
investigating the ideas:

http://learnyousomeerlang.com/supervisors

-Michel


>
> -Pieter
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20140424/a2598315/attachment.htm>