[zeromq-dev] Gossip discovery in CZMQ

Pieter Hintjens ph at imatix.com
Tue Jun 3 22:47:38 CEST 2014


I've pushed a first cut here: https://github.com/zeromq/czmq/pull/507

It isn't finished yet but it shows the overall design.

On Mon, Jun 2, 2014 at 8:00 PM, Pieter Hintjens <ph at imatix.com> wrote:
> Yes, that's the use case: clusters of edge brokers (one per box,
> serving local clients via IPC), that connect together into a Zyre
> network, without the delicacy of UDP beaconing.
>
> On Mon, Jun 2, 2014 at 7:52 PM, Michel Pelletier
> <pelletier.michel at gmail.com> wrote:
>> This would be cool, and be quite useful for your distributed pipes idea.
>>
>> -Michel
>>
>>
>> On Mon, Jun 2, 2014 at 3:48 AM, Pieter Hintjens <ph at imatix.com> wrote:
>>>
>>> Yes, something like that. Right now we're using beaconing for
>>> discovery on local networks. This is simple but doesn't scale very
>>> well. So my idea is to allow nodes to bind/connect and create a
>>> loosely connected discovery network (in parallel with any actual
>>> traffic network), to exchange endpoint/service tuples.
>>>
>>> On Mon, Jun 2, 2014 at 9:23 AM, Arnaud Loonstra <arnaud at sphaero.org>
>>> wrote:
>>> > On 06/01/2014 02:15 PM, Pieter Hintjens wrote:
>>> >> Hi all,
>>> >>
>>> >> For Zyre (and zbroker), I'm adding a gossip discovery service into
>>> >> CZMQ. I've posted the API outline:
>>> >>
>>> >> https://github.com/hintjens/czmq/commit/6081970ba7ac434e9d899bc81b7495a36a17b38c
>>> >>
>>> >> The goal is to build clusters (like Zyre) using gossip discovery
>>> >> instead of (or alongside) UDP beaconing.
>>> >>
>>> >> If anyone has already written such protocols, I'm happy to learn from
>>> >> your experience. Otherwise I'll build a simple gossip protocol from
>>> >> scratch. It has to work across all connected transports.
>>> >>
>>> >> Cheers
>>> >> Pieter
>>> >> _______________________________________________
>>> >> zeromq-dev mailing list
>>> >> zeromq-dev at lists.zeromq.org
>>> >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>> >>
>>> >
>>> > What do you mean with a gossip protocol. Are you suggesting a protocol
>>> > like OSPF in which nodes exchange what they know?
>>> >
>>> > Rg,
>>> >
>>> > Arnaud
>>> > --
>>> > w: http://www.sphaero.org
>>> > t: http://twitter.com/sphaero
>>> > g: http://github.com/sphaero
>>> > i: freenode: sphaero_z25
>>> > _______________________________________________
>>> > zeromq-dev mailing list
>>> > zeromq-dev at lists.zeromq.org
>>> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>> _______________________________________________
>>> zeromq-dev mailing list
>>> zeromq-dev at lists.zeromq.org
>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>>
>>
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>



More information about the zeromq-dev mailing list