[zeromq-dev] Router to router delay

[Cem Karan]

OK, you're doing something similar to what I'm trying to do, except that you're planning on expanding to a WAN.  I'm going to outline what I'm doing, but I want to note that what I have are a number of pieces of test code that let me make sure that the way I'm using zmq makes sense.  I haven't tried to push large amounts of data through yet, so it may break.  With that disclaimer in mind...

I started out with router-router connections, but switched to pub-sub over epgm and administratively scoped multicast addresses (http://en.wikipedia.org/wiki/Multicast_address#Administratively_Scoped_IPv4_Multicast_addresses) for precisely the reasons you outlined in your original email; it isn't easy distributing the addresses.  In my code, each node has one publisher socket and one subscriber socket.  All publishers and all subscribers are connected to the same address and port.   This means that I effectively have a reliable broadcast channel (epgm ensures that all receivers get the message, in the correct order, etc.).  I wrote a simple control layer/protocol on top that allows all nodes to communicate some minimal control information, which in your case might include zmq URIs.  That should allow router-router connections.

I don't know if the IANA has any addresses in the ad-hoc block (http://en.wikipedia.org/wiki/Multicast_address#AD-HOC_block) which are open to individual developers, but that is another thing to look at; if you can get permission to use an address in there, then the pub-sub trick would work across the internet. 

Thanks,
Cem Karan

On Jul 28, 2012, at 8:11 AM, Bjorn Reese wrote:

> On 2012-07-28 13:02, Cem Karan wrote:
>> Can you describe your system a bit more?  Are the peers on the same LAN, or do they need to peer across the internet?  Do the peers already know about each other (as in, a small group with well-known identities), or do they have to discover each other?  etc...
> 
> Initially, all peers are on the same LAN where they discover each other
> via ZeroConf (Bonjour). These local peers constitutes one cluster.
> Later this has to be extended to several clusters communicating over
> WAN. The exact means for this has not been determined yet.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 1581 bytes
Desc: not available
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20120728/5647a062/attachment.bin>