[zeromq-dev] Zyre clustering in malamute broker

Greg Young gregoryyoung1 at gmail.com
Thu Mar 17 23:58:27 CET 2016


This is not the first time people have looked a such problems.

On Thu, Mar 17, 2016 at 10:21 PM, Pieter Hintjens <ph at imatix.com> wrote:
> I think the difficulty is that a cluster of brokers usually means more
> than backup or load balancing; it means federation of some kind.
> Imagine local clients talking IPC to brokers that interconnect over
> TCP. This allows for very thin local client stacks (single threaded
> IPC does not need a full ZeroMQ). Brokers then need to interconnect
> and trade subscriptions and streams (optimally, since most traffic is
> local to local and never needs to cross the network).
>
> On Thu, Mar 17, 2016 at 6:08 PM, Greg Young <gregoryyoung1 at gmail.com> wrote:
>> I have all the logic for this if needed though normally you don't need all
>> involved just say 3 or 5 (heterogenus in larger configurations homogenous in
>> smaller)
>>
>> Greg
>>
>> On Mar 17, 2016 10:18 AM, "Pieter Hintjens" <ph at imatix.com> wrote:
>>>
>>> Hi Arnaud,
>>>
>>> We were working on something similar, which was to elect one Malamute
>>> instance in a cluster as leader and then tell clients where it was. It
>>> is a nice first step to making hot-hot clustering.
>>>
>>> -Pieter
>>>
>>> On Thu, Mar 17, 2016 at 9:08 AM, Arnaud Loonstra <arnaud at sphaero.org>
>>> wrote:
>>> > Isn't this what we were working on during the hackathon in Brussels? It
>>> > indeed seemed trivial but I recall many were using higher level
>>> > languages so my efforts ended up in getting malamute support for higher
>>> > level languages. There were some people that really saw the need of
>>> > this. I'm wondering whether anybody continued with it after the
>>> > hackathon or what stopped them from doing so.
>>> >
>>> > Rg,
>>> >
>>> > Arnaud
>>> >
>>> > On 2016-03-16 21:40, Pieter Hintjens wrote:
>>> >> It's not implemented. You're not the only lazy bastard around :)
>>> >>
>>> >> To make this work is non-trivial. Zyre would make it easy to find
>>> >> other instances. What you do then is to exchange subscriptions and
>>> >> then cross publish. And then the same for mailboxes and services. A
>>> >> federation model.
>>> >>
>>> >> I may update the whitepaper to remove all the speculative design.
>>> >>
>>> >> -Pieter
>>> >>
>>> >> On Wed, Mar 16, 2016 at 7:36 PM, Mario Steinhoff
>>> >> <steinhoff.mario at gmail.com> wrote:
>>> >>> Hey everyone,
>>> >>>
>>> >>> the malamute discussion whitepaper says:
>>> >>>
>>> >>>> A peer-to-peer cluster of Malamute brokers serving a cloud, where
>>> >>>> each system on the cloud runs one Malamute broker. Applications
>>> >>>> connect to their local broker over IPC, and the brokers talk to each
>>> >>>> other over TCP. Malamute uses the Zyre clustering technology to
>>> >>>> rapidly discover and connect to new Malamute brokers.
>>> >>>
>>> >>> I am a lazy bastard and haven't checked the code yet.
>>> >>>
>>> >>> Is this functionality actually implemented?
>>> >>>
>>> >>> If not, what would I have to do?
>>> >>>
>>> >>> Mario
>>> >>> _______________________________________________
>>> >>> zeromq-dev mailing list
>>> >>> zeromq-dev at lists.zeromq.org
>>> >>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>> >> _______________________________________________
>>> >> zeromq-dev mailing list
>>> >> zeromq-dev at lists.zeromq.org
>>> >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>> >
>>> > _______________________________________________
>>> > zeromq-dev mailing list
>>> > zeromq-dev at lists.zeromq.org
>>> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>> _______________________________________________
>>> zeromq-dev mailing list
>>> zeromq-dev at lists.zeromq.org
>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>>
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev



-- 
Studying for the Turing test



More information about the zeromq-dev mailing list