[zeromq-dev] Anybody with updated performance results http://zeromq.org/area:results ?

[Luca Boccassi]

Thank you, that's great!
Getting anywhere close to 10gig line rate without bypassing the kernel
TCP stack is not really likely - as you correctly pointed out, the way
to do that would be to use a different stack based on DPDK (or XDP)
like VPP or F-stack. I have briefly looked into this in the past, but
didn't have time to do anything. It's a lot of integration work.
Another improvement that can help is using the new zero-copy kernel TCP
read/write APIs - I had started something a couple of years back, but
again didn't have time to complete it.
On Wed, 2019-08-07 at 00:34 +0200, Francesco wrote:
> Hi Luca, Hi all,
> I generated the results graph and put all of them here:
> 
>  http://zeromq.org/results:10gbe-tests-v432
> 
> I would say the results are ok but perhaps there's room for
> improvements.
> For example: the local_thr/remote_thr benchmarks show that ZeroMQ is
> able to fill the 10Gbps link only using message sizes of about 10kB.
> The CPUs of the test spiked at about 3.5 Mpps @ 16B message-size 
> which is a bit far from the theoretical max of Ethernet that for 84B
> frames (on the wire) is 14.8Mpps (see 
> https://kb.juniper.net/InfoCenter/index?page=content&id=KB14737).
> 
> I wonder how ZeroMQ message batching mechanism works for small
> messages (<1kB) on TCP... anybody can shed some light on this?
> Thanks!
> 
> Francesco
> 
> 
> PS: any project to use something like F-stack (
> http://www.f-stack.org/) on top of DPDK as backend for ZeroMQ :) ?
> 
> 
> 
> 
> 
> Il giorno dom 4 ago 2019 alle ore 20:41 Luca Boccassi <
> luca.boccassi at gmail.com> ha scritto:
> > Looks great, thank you!
> > On Sun, 4 Aug 2019, 18:28 Francesco, <francesco.montorsi at gmail.com>
> > wrote:
> > > Hi,
> > >  > There's nothing that I know of for that purpose 
> > > I wrote a 70lines bash script to automate the collection of
> > > performance results using "{local/remote/inproc/proxy}_{thr/lat}"
> > > ZMQ performance utils... 
> > > I created a PR for that: 
> > > https://github.com/zeromq/libzmq/pull/3607
> > > 
> > > Let me know if that works for you.
> > > 
> > > As soon as I have the HW available I will use them to generate
> > > the new graphs... 
> > > 
> > > Thanks
> > > 
> > > Francesco
> > > Il giorno sab 3 ago 2019 alle ore 11:39 Luca Boccassi <
> > > luca.boccassi at gmail.com> ha scritto:
> > > > There's nothing that I know of for that purpose
> > > > On Sat, 3 Aug 2019, 10:24 Francesco, <
> > > > francesco.montorsi at gmail.com> wrote:
> > > > > Hi Luca,I don't have a wikidot account... however I have a
> > > > > basic question before getting there: 
> > > > >    local_thr / remote_thr 
> > > > > utilities are just producing a text output... is there any
> > > > > script to:
> > > > > 1) run them automatically to generate all points of the per-
> > > > > message-size graphs (
> > > > > http://zeromq.org/results:10gbe-tests-v031) ?
> > > > > 2) produce the actual graph from the collected text outputs ?
> > > > > 
> > > > > Thanks,
> > > > > Francesco
> > > > > 
> > > > > 
> > > > > 
> > > > > Il giorno sab 3 ago 2019 alle ore 00:40 Luca Boccassi <
> > > > > luca.boccassi at gmail.com> ha scritto:
> > > > > > Yes please!
> > > > > > Do you have an account on wikidot to edit the page?
> > > > > > On Fri, 2 Aug 2019, 21:54 Francesco, <
> > > > > > francesco.montorsi at gmail.com> wrote:
> > > > > > > Hi all,
> > > > > > > I noticed that all performance results reported at this
> > > > > > > page:
> > > > > > >   http://zeromq.org/area:results
> > > > > > > seem a bit outdated (most updated version looks
> > > > > > > like  ØMQ/2.0.6 !)... has anybody updated results?
> > > > > > > Alternatively I may be able to generate measurements on
> > > > > > > latest libzmq on 10G NICs... would you be interested in
> > > > > > > putting on that page updated results?
> > > > > > > 
> > > > > > > 
> > > > > > > Thanks,
> > > > > > > Francesco
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > _______________________________________________
> > > > > > > 
> > > > > > > zeromq-dev mailing list
> > > > > > > 
> > > > > > > zeromq-dev at lists.zeromq.org
> > > > > > > 
> > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > > > 
> > > > > > 
> > > > > > _______________________________________________
> > > > > > 
> > > > > > zeromq-dev mailing list
> > > > > > 
> > > > > > zeromq-dev at lists.zeromq.org
> > > > > > 
> > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > > 
> > > > > 
> > > > > _______________________________________________
> > > > > 
> > > > > zeromq-dev mailing list
> > > > > 
> > > > > zeromq-dev at lists.zeromq.org
> > > > > 
> > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > > 
> > > > 
> > > > _______________________________________________
> > > > 
> > > > zeromq-dev mailing list
> > > > 
> > > > zeromq-dev at lists.zeromq.org
> > > > 
> > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > > 
> > > 
> > > _______________________________________________
> > > 
> > > zeromq-dev mailing list
> > > 
> > > zeromq-dev at lists.zeromq.org
> > > 
> > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > > 
> > 
> > _______________________________________________
> > 
> > zeromq-dev mailing list
> > 
> > zeromq-dev at lists.zeromq.org
> > 
> > https://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > 
> 
> _______________________________________________zeromq-dev mailing 
> listzeromq-dev at lists.zeromq.org
> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
-- 
Kind regards,
Luca Boccassi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20190807/2b4d8037/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: This is a digitally signed message part
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20190807/2b4d8037/attachment.sig>