[zeromq-dev] sending 20MB messages using zeromq

Joseph L. Brunner joe at affirmedsystems.com
Tue May 13 18:45:20 CEST 2014


Remove interrupts from that core…



From: zeromq-dev-bounces at lists.zeromq.org [mailto:zeromq-dev-bounces at lists.zeromq.org] On Behalf Of Ben Kloosterman
Sent: Tuesday, May 13, 2014 8:32 AM
To: ZeroMQ development list
Subject: Re: [zeromq-dev] sending 20MB messages using zeromq

Load balanced NICs , 10G ethernet  ( and on 10G Ethernet watch the CPU )  .

Ben

On Mon, May 12, 2014 at 9:48 PM, Dileep Mandapam <dileep.mandapam at techmojo.in<mailto:dileep.mandapam at techmojo.in>> wrote:
Hi,

Use-case :-  I have 'N' request processor threads which sends responses to 1 node.js server using ZEROMQ PUB/SUB .To improve performance, I have offloaded publishing task to one dedicated thread ,which keeps on sending responses .

My question is ,Is there any to improve throughput ?

sample test results :-

12 May 2014 13:26:11,199 1239673 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 62 milli seconds for  100 payloads
12 May 2014 13:26:11,460 1239934 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 44 milli seconds for  100 payloads
12 May 2014 13:26:11,782 1240256 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 47 milli seconds for  100 payloads
12 May 2014 13:26:12,132 1240606 [zmqPub--2-thread-1] INFO LOGGER  - sendResponses took 59 milli seconds for  100 payloads
12 May 2014 13:26:12,407 1240881 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:12,744 1241218 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:12,789 1241263 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 7 milli seconds for  10 payloads
12 May 2014 13:26:13,627 1242101 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 207 milli seconds for  100 payloads
12 May 2014 13:26:14,336 1242810 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 117 milli seconds for  100 payloads
12 May 2014 13:26:15,073 1243547 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 310 milli seconds for  100 payloads
12 May 2014 13:26:16,026 1244500 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 225 milli seconds for  100 payloads
12 May 2014 13:26:16,359 1244833 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 60 milli seconds for  100 payloads
12 May 2014 13:26:16,661 1245135 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 54 milli seconds for  100 payloads
12 May 2014 13:26:17,056 1245530 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 56 milli seconds for  100 payloads
12 May 2014 13:26:17,254 1245728 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 40 milli seconds for  38 payloads
12 May 2014 13:26:17,572 1246046 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 51 milli seconds for  100 payloads
12 May 2014 13:26:18,079 1246553 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 142 milli seconds for  100 payloads
12 May 2014 13:26:19,204 1247678 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 195 milli seconds for  100 payloads
12 May 2014 13:26:19,541 1248015 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 65 milli seconds for  100 payloads
12 May 2014 13:26:19,997 1248471 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 55 milli seconds for  100 payloads
12 May 2014 13:26:20,233 1248707 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:20,619 1249093 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 74 milli seconds for  100 payloads
12 May 2014 13:26:20,970 1249444 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:21,325 1249799 [zmqPub--2-thread-1] INFO  _LOGGER  - sendResponses took 103 milli seconds for  100 payloads
12 May 2014 13:26:21,651 1250125 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 57 milli seconds for  100 payloads
12 May 2014 13:26:21,913 1250387 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 40 milli seconds for  100 payloads
12 May 2014 13:26:22,276 1250750 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:22,692 1251166 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 202 milli seconds for  100 payloads
12 May 2014 13:26:22,775 1251249 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 13 milli seconds for  10 payloads
12 May 2014 13:26:23,083 1251557 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:23,461 1251935 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:24,032 1252506 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 164 milli seconds for  100 payloads
12 May 2014 13:26:25,112 1253586 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 272 milli seconds for  100 payloads
12 May 2014 13:26:25,510 1253984 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 73 milli seconds for  100 payloads
12 May 2014 13:26:26,345 1254819 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 83 milli seconds for  100 payloads
12 May 2014 13:26:26,789 1255263 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 60 milli seconds for  100 payloads
12 May 2014 13:26:26,848 1255322 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 9 milli seconds for  38 payloads
12 May 2014 13:26:27,421 1255895 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 78 milli seconds for  100 payloads
12 May 2014 13:26:27,787 1256261 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 75 milli seconds for  100 payloads
12 May 2014 13:26:28,600 1257074 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 111 milli seconds for  100 payloads
12 May 2014 13:26:29,090 1257564 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 71 milli seconds for  100 payloads
12 May 2014 13:26:29,465 1257939 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 71 milli seconds for  100 payloads
12 May 2014 13:26:29,808 1258282 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 44 milli seconds for  100 payloads
12 May 2014 13:26:30,172 1258646 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 57 milli seconds for  100 payloads
12 May 2014 13:26:30,397 1258871 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 46 milli seconds for  100 payloads
12 May 2014 13:26:30,785 1259259 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 148 milli seconds for  100 payloads
12 May 2014 13:26:31,025 1259499 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:31,298 1259772 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:31,644 1260118 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:31,804 1260278 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 31 milli seconds for  100 payloads
12 May 2014 13:26:31,841 1260315 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 7 milli seconds for  10 payloads
12 May 2014 13:26:32,750 1261224 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 184 milli seconds for  100 payloads
12 May 2014 13:26:33,343 1261817 [zmqPub--2-thread-1] INFO  LOGGER  - sendResponses took 114 milli seconds for  100 payloads


Thanks
Dileep.

_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20140513/030809ac/attachment.htm>


More information about the zeromq-dev mailing list