[zeromq-dev] sending 20MB messages using zeromq

Dileep Mandapam dileep.mandapam at techmojo.in
Mon May 12 13:48:58 CEST 2014


Hi,

Use-case :-  I have 'N' request processor threads which sends responses to
1 node.js server using ZEROMQ PUB/SUB .To improve performance, I have
offloaded publishing task to one dedicated thread ,which keeps on sending
responses .

My question is ,Is there any to improve throughput ?

*sample test results :- *

12 May 2014 13:26:11,199 1239673 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 62 milli seconds for  100 payloads
12 May 2014 13:26:11,460 1239934 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 44 milli seconds for  100 payloads
12 May 2014 13:26:11,782 1240256 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 47 milli seconds for  100 payloads
12 May 2014 13:26:12,132 1240606 [zmqPub--2-thread-1] INFO LOGGER  -
sendResponses took 59 milli seconds for  100 payloads
12 May 2014 13:26:12,407 1240881 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:12,744 1241218 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:12,789 1241263 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 7 milli seconds for  10 payloads
12 May 2014 13:26:13,627 1242101 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took *207 milli seconds for  100 payloads*
12 May 2014 13:26:14,336 1242810 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took *117 milli seconds for  100 payloads*
12 May 2014 13:26:15,073 1243547 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took* 310 milli seconds for  100 payloads *
12 May 2014 13:26:16,026 1244500 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took *225 milli seconds for  100 payloads*
12 May 2014 13:26:16,359 1244833 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 60 milli seconds for  100 payloads
12 May 2014 13:26:16,661 1245135 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 54 milli seconds for  100 payloads
12 May 2014 13:26:17,056 1245530 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 56 milli seconds for  100 payloads
12 May 2014 13:26:17,254 1245728 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 40 milli seconds for  38 payloads
12 May 2014 13:26:17,572 1246046 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 51 milli seconds for  100 payloads
12 May 2014 13:26:18,079 1246553 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 142 milli seconds for  100 payloads
12 May 2014 13:26:19,204 1247678 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 195 milli seconds for  100 payloads
12 May 2014 13:26:19,541 1248015 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 65 milli seconds for  100 payloads
12 May 2014 13:26:19,997 1248471 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 55 milli seconds for  100 payloads
12 May 2014 13:26:20,233 1248707 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:20,619 1249093 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 74 milli seconds for  100 payloads
12 May 2014 13:26:20,970 1249444 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:21,325 1249799 [zmqPub--2-thread-1] INFO  _LOGGER  -
sendResponses took 103 milli seconds for  100 payloads
12 May 2014 13:26:21,651 1250125 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 57 milli seconds for  100 payloads
12 May 2014 13:26:21,913 1250387 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 40 milli seconds for  100 payloads
12 May 2014 13:26:22,276 1250750 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:22,692 1251166 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 202 milli seconds for  100 payloads
12 May 2014 13:26:22,775 1251249 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 13 milli seconds for  10 payloads
12 May 2014 13:26:23,083 1251557 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 53 milli seconds for  100 payloads
12 May 2014 13:26:23,461 1251935 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:24,032 1252506 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 164 milli seconds for  100 payloads
12 May 2014 13:26:25,112 1253586 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 272 milli seconds for  100 payloads
12 May 2014 13:26:25,510 1253984 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 73 milli seconds for  100 payloads
12 May 2014 13:26:26,345 1254819 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 83 milli seconds for  100 payloads
12 May 2014 13:26:26,789 1255263 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 60 milli seconds for  100 payloads
12 May 2014 13:26:26,848 1255322 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 9 milli seconds for  38 payloads
12 May 2014 13:26:27,421 1255895 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 78 milli seconds for  100 payloads
12 May 2014 13:26:27,787 1256261 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 75 milli seconds for  100 payloads
12 May 2014 13:26:28,600 1257074 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 111 milli seconds for  100 payloads
12 May 2014 13:26:29,090 1257564 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 71 milli seconds for  100 payloads
12 May 2014 13:26:29,465 1257939 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 71 milli seconds for  100 payloads
12 May 2014 13:26:29,808 1258282 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 44 milli seconds for  100 payloads
12 May 2014 13:26:30,172 1258646 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 57 milli seconds for  100 payloads
12 May 2014 13:26:30,397 1258871 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 46 milli seconds for  100 payloads
12 May 2014 13:26:30,785 1259259 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 148 milli seconds for  100 payloads
12 May 2014 13:26:31,025 1259499 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:31,298 1259772 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 45 milli seconds for  100 payloads
12 May 2014 13:26:31,644 1260118 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 66 milli seconds for  100 payloads
12 May 2014 13:26:31,804 1260278 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 31 milli seconds for  100 payloads
12 May 2014 13:26:31,841 1260315 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 7 milli seconds for  10 payloads
12 May 2014 13:26:32,750 1261224 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 184 milli seconds for  100 payloads
12 May 2014 13:26:33,343 1261817 [zmqPub--2-thread-1] INFO  LOGGER  -
sendResponses took 114 milli seconds for  100 payloads


Thanks
Dileep.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20140512/a2245f5a/attachment.htm>


More information about the zeromq-dev mailing list