[zeromq-dev] Announcing ZFL

[Jon Dyte]

Pieter Hintjens wrote:
> On Sat, Aug 21, 2010 at 8:02 AM, Martin Sustrik <sustrik at 250bpm.com> wrote:
>
>   
>> One thing really missing is device multiplexing. I.e. imagine you want to
>> create 10,000 mini-queues. Right now you have to create 10k threads. It
>> would be nice if the devices can be lumped together is a single thread.
>>     
>
> This only really applies to queues, right?  So this would be a device
> able to handle many pairs of endpoints in parallel.  The main problem
> with that is that 10k endpoint pairs is a real management issue. That
> is a lot of TCP ports and a really brittle network. You'd really want
> to switch over to a single endpoint that abstracts the queue name in
> the protocol, and then you get a queue broker.  That can still be a
> device.
>
> So you don't want "device multiplexing", but rather a queue broker.
> Is that correct?
>
>   
i think martin means a device running say 5 queues, 10 forwarders and 23 
streamers.

as it stands that will take 38 threads.

 all 76 sockets could be put into one zmq_poll or reactor. running in 
one thread, but working
out the callback for each one and what to do  on POLLIN/POLLOUT would 
require functions
to be registered as well.

the more i think about this the more Matt's reactor pattern springs to mind

jon






> -
> Pieter Hintjens
> iMatix - www.imatix.com
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>