[zeromq-dev] sending 20MB messages using zeromq

Ben Kloosterman bklooste at gmail.com
Tue May 13 14:31:52 CEST 2014


Load balanced NICs , 10G ethernet  ( and on 10G Ethernet watch the CPU )  .

Ben


On Mon, May 12, 2014 at 9:48 PM, Dileep Mandapam <
dileep.mandapam at techmojo.in> wrote:

> Hi,
>
> Use-case :-  I have 'N' request processor threads which sends responses to
> 1 node.js server using ZEROMQ PUB/SUB .To improve performance, I have
> offloaded publishing task to one dedicated thread ,which keeps on sending
> responses .
>
> My question is ,Is there any to improve throughput ?
>
> *sample test results :- *
>
> 12 May 2014 13:26:11,199 1239673 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 62 milli seconds for  100 payloads
> 12 May 2014 13:26:11,460 1239934 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 44 milli seconds for  100 payloads
> 12 May 2014 13:26:11,782 1240256 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 47 milli seconds for  100 payloads
> 12 May 2014 13:26:12,132 1240606 [zmqPub--2-thread-1] INFO LOGGER  -
> sendResponses took 59 milli seconds for  100 payloads
> 12 May 2014 13:26:12,407 1240881 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 45 milli seconds for  100 payloads
> 12 May 2014 13:26:12,744 1241218 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 53 milli seconds for  100 payloads
> 12 May 2014 13:26:12,789 1241263 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 7 milli seconds for  10 payloads
> 12 May 2014 13:26:13,627 1242101 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took *207 milli seconds for  100 payloads*
> 12 May 2014 13:26:14,336 1242810 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took *117 milli seconds for  100 payloads*
> 12 May 2014 13:26:15,073 1243547 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took* 310 milli seconds for  100 payloads *
> 12 May 2014 13:26:16,026 1244500 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took *225 milli seconds for  100 payloads*
> 12 May 2014 13:26:16,359 1244833 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 60 milli seconds for  100 payloads
> 12 May 2014 13:26:16,661 1245135 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 54 milli seconds for  100 payloads
> 12 May 2014 13:26:17,056 1245530 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 56 milli seconds for  100 payloads
> 12 May 2014 13:26:17,254 1245728 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 40 milli seconds for  38 payloads
> 12 May 2014 13:26:17,572 1246046 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 51 milli seconds for  100 payloads
> 12 May 2014 13:26:18,079 1246553 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 142 milli seconds for  100 payloads
> 12 May 2014 13:26:19,204 1247678 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 195 milli seconds for  100 payloads
> 12 May 2014 13:26:19,541 1248015 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 65 milli seconds for  100 payloads
> 12 May 2014 13:26:19,997 1248471 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 55 milli seconds for  100 payloads
> 12 May 2014 13:26:20,233 1248707 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 45 milli seconds for  100 payloads
> 12 May 2014 13:26:20,619 1249093 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 74 milli seconds for  100 payloads
> 12 May 2014 13:26:20,970 1249444 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 53 milli seconds for  100 payloads
> 12 May 2014 13:26:21,325 1249799 [zmqPub--2-thread-1] INFO  _LOGGER  -
> sendResponses took 103 milli seconds for  100 payloads
> 12 May 2014 13:26:21,651 1250125 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 57 milli seconds for  100 payloads
> 12 May 2014 13:26:21,913 1250387 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 40 milli seconds for  100 payloads
> 12 May 2014 13:26:22,276 1250750 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 66 milli seconds for  100 payloads
> 12 May 2014 13:26:22,692 1251166 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 202 milli seconds for  100 payloads
> 12 May 2014 13:26:22,775 1251249 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 13 milli seconds for  10 payloads
> 12 May 2014 13:26:23,083 1251557 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 53 milli seconds for  100 payloads
> 12 May 2014 13:26:23,461 1251935 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 66 milli seconds for  100 payloads
> 12 May 2014 13:26:24,032 1252506 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 164 milli seconds for  100 payloads
> 12 May 2014 13:26:25,112 1253586 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 272 milli seconds for  100 payloads
> 12 May 2014 13:26:25,510 1253984 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 73 milli seconds for  100 payloads
> 12 May 2014 13:26:26,345 1254819 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 83 milli seconds for  100 payloads
> 12 May 2014 13:26:26,789 1255263 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 60 milli seconds for  100 payloads
> 12 May 2014 13:26:26,848 1255322 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 9 milli seconds for  38 payloads
> 12 May 2014 13:26:27,421 1255895 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 78 milli seconds for  100 payloads
> 12 May 2014 13:26:27,787 1256261 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 75 milli seconds for  100 payloads
> 12 May 2014 13:26:28,600 1257074 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 111 milli seconds for  100 payloads
> 12 May 2014 13:26:29,090 1257564 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 71 milli seconds for  100 payloads
> 12 May 2014 13:26:29,465 1257939 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 71 milli seconds for  100 payloads
> 12 May 2014 13:26:29,808 1258282 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 44 milli seconds for  100 payloads
> 12 May 2014 13:26:30,172 1258646 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 57 milli seconds for  100 payloads
> 12 May 2014 13:26:30,397 1258871 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 46 milli seconds for  100 payloads
> 12 May 2014 13:26:30,785 1259259 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 148 milli seconds for  100 payloads
> 12 May 2014 13:26:31,025 1259499 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 45 milli seconds for  100 payloads
> 12 May 2014 13:26:31,298 1259772 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 45 milli seconds for  100 payloads
> 12 May 2014 13:26:31,644 1260118 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 66 milli seconds for  100 payloads
> 12 May 2014 13:26:31,804 1260278 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 31 milli seconds for  100 payloads
> 12 May 2014 13:26:31,841 1260315 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 7 milli seconds for  10 payloads
> 12 May 2014 13:26:32,750 1261224 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 184 milli seconds for  100 payloads
> 12 May 2014 13:26:33,343 1261817 [zmqPub--2-thread-1] INFO  LOGGER  -
> sendResponses took 114 milli seconds for  100 payloads
>
>
> Thanks
> Dileep.
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20140513/37a4d54d/attachment.htm>


More information about the zeromq-dev mailing list