[zeromq-dev] Anybody with updated performance results http://zeromq.org/area:results ?

Wed Aug 7 16:04:56 CEST 2019

On Wed, 2019-08-07 at 14:50 +0200, Francesco wrote:
> Hi Luca,
> 
> 
> Il giorno mer 7 ago 2019 alle ore 11:48 Luca Boccassi <
> luca.boccassi at gmail.com> ha scritto:
> > Thank you, that's great!
> > 
> 
> I may be able to repeat also the same tests, still on 10Gb optical
> link, using 2 Mellanox CX5 NICs... I will post here new results if I
> can.
> 
> > Getting anywhere close to 10gig line rate without bypassing the
> > kernel TCP stack is not really likely - as you correctly pointed
> > out, the way to do that would be to use a different stack based on
> > DPDK (or XDP) like VPP or F-stack. I have briefly looked into this
> > in the past, but didn't have time to do anything. It's a lot of
> > integration work.
> > 
> 
> I agree - I wonder if things could be different if ZMQ had a sponsor
> to support it...
> 
> > Another improvement that can help is using the new zero-copy kernel
> > TCP read/write APIs - I had started something a couple of years
> > back, but again didn't have time to complete it.
> > 
> 
> This looks very interesting as well.. do you have any pointer to
> these new zero-copy kernel APIs?
> 
> Thanks,
> Francesco

Kernel docs:

https://www.kernel.org/doc/html/v5.2/networking/msg_zerocopy.html

This is the initial experiment, very much incomplete:

https://github.com/bluca/libzmq/commit/d021ea5f2c7526b388cb8f8005298e30b4cadd62

> > On Wed, 2019-08-07 at 00:34 +0200, Francesco wrote:
> > > Hi Luca, Hi all,
> > > 
> > > I generated the results graph and put all of them here:
> > > 
> > >  http://zeromq.org/results:10gbe-tests-v432
> > > 
> > > I would say the results are ok but perhaps there's room for
> > > improvements.
> > > For example: the local_thr/remote_thr benchmarks show that ZeroMQ
> > > is able to fill the 10Gbps link only using message sizes of about
> > > 10kB.
> > > The CPUs of the test spiked at about 3.5 Mpps @ 16B message-size  
> > > which is a bit far from the theoretical max of Ethernet that for
> > > 84B frames (on the wire) is 14.8Mpps (see 
> > > https://kb.juniper.net/InfoCenter/index?page=content&id=KB14737).
> > > 
> > > I wonder how ZeroMQ message batching mechanism works for small
> > > messages (<1kB) on TCP... anybody can shed some light on this?
> > > Thanks!
> > > 
> > > Francesco
> > > 
> > > 
> > > PS: any project to use something like F-stack (
> > > http://www.f-stack.org/) on top of DPDK as backend for ZeroMQ :)
> > > ?
> > > 
> > > 
> > > 
> > > 
> > > Il giorno dom 4 ago 2019 alle ore 20:41 Luca Boccassi <
> > > luca.boccassi at gmail.com> ha scritto:
> > > > Looks great, thank you!
> > > > 
> > > > On Sun, 4 Aug 2019, 18:28 Francesco, <
> > > > francesco.montorsi at gmail.com> wrote:
> > > > > Hi,
> > > > > 
> > > > >  > There's nothing that I know of for that purpose
> > > > >  
> > > > > I wrote a 70lines bash script to automate the collection of
> > > > > performance results using
> > > > > "{local/remote/inproc/proxy}_{thr/lat}" ZMQ performance
> > > > > utils... 
> > > > > I created a PR for that: 
> > > > > https://github.com/zeromq/libzmq/pull/3607
> > > > > 
> > > > > Let me know if that works for you.
> > > > > 
> > > > > As soon as I have the HW available I will use them to
> > > > > generate the new graphs... 
> > > > > 
> > > > > Thanks
> > > > > 
> > > > > Francesco
> > > > > 
> > > > > Il giorno sab 3 ago 2019 alle ore 11:39 Luca Boccassi <
> > > > > luca.boccassi at gmail.com> ha scritto:
> > > > > > There's nothing that I know of for that purpose
> > > > > > 
> > > > > > On Sat, 3 Aug 2019, 10:24 Francesco, <
> > > > > > francesco.montorsi at gmail.com> wrote:
> > > > > > > Hi Luca,
> > > > > > > I don't have a wikidot account... however I have a basic
> > > > > > > question before getting there: 
> > > > > > >    local_thr / remote_thr 
> > > > > > > utilities are just producing a text output... is there
> > > > > > > any script to:
> > > > > > > 1) run them automatically to generate all points of the
> > > > > > > per-message-size graphs (
> > > > > > > http://zeromq.org/results:10gbe-tests-v031) ?
> > > > > > > 2) produce the actual graph from the collected text
> > > > > > > outputs ?
> > > > > > > 
> > > > > > > Thanks,
> > > > > > > Francesco
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > Il giorno sab 3 ago 2019 alle ore 00:40 Luca Boccassi <
> > > > > > > luca.boccassi at gmail.com> ha scritto:
> > > > > > > > Yes please!
> > > > > > > > 
> > > > > > > > Do you have an account on wikidot to edit the page?
> > > > > > > > 
> > > > > > > > On Fri, 2 Aug 2019, 21:54 Francesco, <
> > > > > > > > francesco.montorsi at gmail.com> wrote:
> > > > > > > > > Hi all,
> > > > > > > > > I noticed that all performance results reported at
> > > > > > > > > this page:
> > > > > > > > >   http://zeromq.org/area:results
> > > > > > > > > seem a bit outdated (most updated version looks
> > > > > > > > > like  ØMQ/2.0.6 !)... has anybody updated results?
> > > > > > > > > Alternatively I may be able to generate measurements
> > > > > > > > > on latest libzmq on 10G NICs... would you be
> > > > > > > > > interested in putting on that page updated results?
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > Thanks,
> > > > > > > > > Francesco
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > _______________________________________________
> > > > > > > > > zeromq-dev mailing list
> > > > > > > > > zeromq-dev at lists.zeromq.org
> > > > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > > > > 
> > > > > > > > _______________________________________________
> > > > > > > > zeromq-dev mailing list
> > > > > > > > zeromq-dev at lists.zeromq.org
> > > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > > > 
> > > > > > > _______________________________________________
> > > > > > > zeromq-dev mailing list
> > > > > > > zeromq-dev at lists.zeromq.org
> > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > > 
> > > > > > _______________________________________________
> > > > > > zeromq-dev mailing list
> > > > > > zeromq-dev at lists.zeromq.org
> > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > 
> > > > > _______________________________________________
> > > > > zeromq-dev mailing list
> > > > > zeromq-dev at lists.zeromq.org
> > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > 
> > > > _______________________________________________
> > > > zeromq-dev mailing list
> > > > zeromq-dev at lists.zeromq.org
> > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > 
> > > _______________________________________________
> > > zeromq-dev mailing list
> > > zeromq-dev at lists.zeromq.org
> > > 
> > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > 
> > 
> > -- 
> > 
> > Kind regards,
> > Luca Boccassi
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev at lists.zeromq.org
> > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> 
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> 
> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> 
> 
-- 
Kind regards,
Luca Boccassi
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: This is a digitally signed message part
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20190807/f8427281/attachment.sig>