[zeromq-dev] Load Balancing/Distributing/Queuing Algos: A Discussion

[Peter Alexander]

>> Is it in consideration to make load-balancing/distributing algorithm
types
>> optional and possibly even optionally custom (supplied by the user). I
can
>> see where this will be important to me in the near future.

> It's been discussed, but as always we enter the trade-offs of API
> simplicity and scalability vs. functionality.

> What I'd like to explore is how to build custom distribution
> algorithms using the existing patterns, specifically request-reply.

Hi Pieter and thanks for your reply to this question in the other thread. I
moved it here to see if we could all discuss this some more and come to some
possible conclusion and/or road-map.

I feel it's important to, in some way, make a selection of
balancing/distributing algorithms an optional flag which could maybe part of
the flag set in zmq_setsockopts().

Ideally, I would also like to have the ability for the user to provide their
own algorithms (in a callback, for instance) for custom/unique situations
(like I have). Otherwise I guess we could just submit these somewhat custom
algorithms for inclusion into the code base to be used in the flag
mechanism.. I don't know, just thinking out loud here.

Otherwise, will it make sockets such as PUSH/PULL (in my use-case) useless
in these circumstances? I really haven't delved deeply into thought of my
use-case yet, but at this point it seems it will.

Using other mechanisms to overcome the built in round-robin, for example,
defeats the efficiency of 0mq and therefore it needs to be built-in, imo.

Another point that I've put no thought into yet is: are these concerns I
have for balancing/distributing also pertinent to fair-queuing? Others may
have some thought on this..

~Peter
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20100817/4fc4d407/attachment.htm>