[zeromq-dev] Urgent! Where is the link between ZeroMq and IpoIB

Jim Garlick garlick at llnl.gov
Mon May 5 22:53:51 CEST 2014

Hi Krishna,

As far as I know ZeroMQ can only use IPoIB via normal IP sockets.
Looks like the idea of an RDMA zeromq transport came up in 2011,
but went nowhere?


Another interesting example of adding RDMA support to a project with
pluggable transports is net/9p (transport for fs/v9fs) in the Linux kernel.
It might be useful to look at that code and follow its history to understand
the problem better.


As I recall the orig code in 2008, though functional, didn't deliver a big
performance win over TCP (for that stack) and introduced new failure modes,
making it unattractive and frustrating for casual users.  It languished
for years in a semi-broken state until people at CEA/Bull began working
on it again in 2012-13.  I'm guessing the second order issues CEA/Bull
dealt with would be instructive.  Also their Mooshika RDMA abstraction,
which I think allows for a wireshark tap and testing w/o Infiniband card
could be interesting.



On Mon, May 05, 2014 at 07:38:05PM +0200, Krishna Narasimhan wrote:
> Hello,
>         I am a researcher at Frankfurt University and currently working on
> contributing to folks who use ZeroMq at Gsi , Darmstadt. Can anyone guide
> me on which part of the code links ZeroMq to IPoIB. Because it doesnt seem
> to be linked at code level. Does ZeroMq call some wrapper which directs to
> IPoIb or normal IP?
> Any help here would be appreciated. this is rather urgent.
> On the other hand, I am also looking to contribute to including MPI (direct
> RDMA) access for ZeroMq based applications, so anyone with this knowledge
> will also be helpful. But am not sure this belongs to this thread.
> Thanks a lot.
> Regards
>        Krishna

> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev

More information about the zeromq-dev mailing list