[zeromq-dev] ZMQ TCP optimization

Martin Hurton hurtonm at gmail.com
Sun Jun 30 09:19:13 CEST 2013


Hi Ori, thanks for update. I pushed a patch that may affect the TCP
window scale option. Could you try with master and let me know if it
affects the throughput? Thanks.

- Martin

On Thu, Jun 27, 2013 at 6:37 PM, Ori Barak <oribarak at microsoft.com> wrote:
> Got the problem solved.
>
> One of the machines had the auto scaling option disabled. I enabled it and also set big value to the sender\receiver buffer size and I got much higher QPS now.
>
> Thanks,
> Ori
>
> -----Original Message-----
> From: zeromq-dev-bounces at lists.zeromq.org [mailto:zeromq-dev-bounces at lists.zeromq.org] On Behalf Of Ori Barak
> Sent: Wednesday, June 26, 2013 7:02 PM
> To: ZeroMQ development list
> Subject: Re: [zeromq-dev] ZMQ TCP optimization
>
> Hi,
>
> Thanks for the help Martin,
> Enclosed are first couple in pcapng format hope it's fine.
>
> It looks as if windo size scaling factor is -2 (no window scaling used). I've tried not using the SND\RECVBUF option and also tried setting it with very high value but didn't see any difference.
>
> Thanks,
> Ori
>
> -----Original Message-----
> From: zeromq-dev-bounces at lists.zeromq.org [mailto:zeromq-dev-bounces at lists.zeromq.org] On Behalf Of Martin Hurton
> Sent: Wednesday, June 26, 2013 2:37 PM
> To: ZeroMQ development list
> Subject: Re: [zeromq-dev] ZMQ TCP optimization
>
> Hi Ori, could you please capture the first 10 packets when you connect to the remote server for me. I would like to check something. Thanks.
>
> - mh
>
> On Wed, Jun 26, 2013 at 10:05 AM, Ori Barak <oribarak at microsoft.com> wrote:
>> Hi,
>>
>>
>>
>> I have an application running on windows using ZMQ Push\Pull TCP sockets.
>>
>> The client\server machines I use have a 1 GB bandwidth.
>>
>> When sending messages between 2 close servers (round trip time <1ms) I
>> get a rate of about  ~110MB/sec. When sending messages between two
>> remote servers (round trip ~70ms) I get ~1.5MB/sec. I was under the
>> impression that the RTT shouldn't affect much on the throughput since
>> the TCP window scaling option is enabled in windows by default
>> (http://en.wikipedia.org/wiki/TCP_window_scale_option ) thus window
>> size can increase up to 1,073,725,440 bytes which basically means the
>> RTT should have little effect.
>>
>>
>>
>> If I open multiple channels on the client side on the same destination
>> port I can get more utilization but I would rather have a single
>> channel working faster.
>>
>>
>>
>> Any ZMQ\TCP configuration I can change to increase network utilization?
>>
>>
>>
>> Thanks,
>>
>> Ori
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev



More information about the zeromq-dev mailing list