[zeromq-dev] ZeroMQ and grid engine match

[Pieter Hintjens]

Hi Iulian,

There's the basis for this architecture in Chapter 8 of the Guide. You can
probably reuse parts of the ZyRE code already, for discovery and
interconnection.

The key parts are:

* UDP discovery
* DEALER to ROUTER topology with one DEALER per peer node; you read from
the ROUTER and write to the DEALER for the relevant peer.

Let me know how it goes and if you need more explanations.

You may in fact be able to use ZyRE as the basis for this, it's already
quite solid for the basic work.

-Pieter


On Fri, Nov 2, 2012 at 8:07 AM, Iulian-Nicu Şerbănoiu <undergraver at gmail.com
> wrote:

> Hello,
>
> I am trying to design a custom grid engine for distributed parallel
> tasks across a LAN. My previous experience with network programming
> consists mainly on intensive use of ACE framework (
> http://www.cs.wustl.edu/~schmidt/ACE.html ).
>
> I would like the grid engine to be with no configuration, with no
> central broker.
> For this I would need to discover the worker machines and I'm thinking
> of using UDP.
> Each task creator machine must be connected to every worker machine
> (TCP) and the scheduling of the tasks will be done on the task creator
> machine.
>
> Can the grid engine described above be created using zeromq? Is zeromq
> a good choice for such project?
> Are there any disadvantages in this design that zeromq overcomes
> somehow? I'm asking this because in the samples and the guide I didn't
> see anything close to this, except the ventilator which unfortunately
> has a central broker in its design.
>
> All the best,
> Iulian
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20121102/051ffccf/attachment.htm>