[zeromq-dev] anyone try to use 0mq for BSP
mkogan at semanticresearch.com
mkogan at semanticresearch.com
Fri Apr 22 16:15:44 CEST 2011
There have been developments lately with the Pregel paper and Apache Hama, I will dig a bit more into it and see I'd I can come up with something and throw it out to the group.
Sent from my iPhone
On Apr 22, 2011, at 6:51 AM, Matt Weinstein <matt_weinstein at yahoo.com> wrote:
> Hadn't seen this one, looks like several models that emerged in the late 80's. (Looks like a forward-only synchronized Time Warp OS :-) ).
>
> From a quick look, there appear to be two protocols:
>
> Inter-node sync
> Two-phase barrier
>
> Assuming this is for tightly coupled nodes, it seems like a simple state driven protocol engine over PUB/SUB would suffice, although Inter-node sync could use point-to-point for efficiency (*)
>
> I haven't addressed protocol error and node recovery here, of course ;-)
>
> Best,
>
> Matt
>
> (*) If I recall, UDP sockets open for host multicast also receive point-to-point messages...? We can't do that using the ØMQ abstraction (I'd like to use the UUIDs if so :-) )
>
>
> On Apr 22, 2011, at 3:19 AM, Pieter Hintjens wrote:
>
>> Michael,
>>
>>> Has anyone tried to apply 0mq in order to implement Bulk Synchronous Parallel computing model? I am curious if anyone had looked into it.
>>
>> How much research have you done into this already? From a brief read
>> of BSP the closest match in 0MQ terms looks like a fanout/fanin
>> pipeline, e.g. http://zguide.zeromq.org/page:all#Divide-and-Conquer.
>>
>> -Pieter
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
More information about the zeromq-dev
mailing list