[zeromq-dev] zeromq low latency requests

[Joss Gray]

You could use zyre ( https://github.com/zeromq/zyre )  to create a network
of worker nodes and then distribute tasks and collate results with a
central server.

On Thu, Aug 27, 2015 at 12:58 PM, Keith Brown <keith6014 at gmail.com> wrote:

> at the moment I am using Python multiprocessing to process requests
> but it won't scale well for over 30+ processes since I don't have that
> many cores. However, I have many desktops in our lab which are idle. I
> was wondering if its possible to use python multiprocessing module
> with zero mq to distribute my tasks and get results quickly.
>
> BTW, each process takes about 1 second to run but there are thousands
> I need to run.
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20150827/64b6d9e7/attachment.htm>