[zeromq-dev] pub-sub losing messages

Michael Keselman michael.keselman at gmail.com
Thu May 23 18:06:37 CEST 2013


Pieter,

It worked, thank you for the help! I was ready to give up :-)

Michael


On Thu, May 23, 2013 at 1:24 AM, Pieter Hintjens <ph at imatix.com> wrote:

> Michael,
>
> Try setting the RCVHWM at the subscriber side. Messages are probably being
> sent fine but overflowing the receiver's buffer, and discarded.
>
> -Pieter
>
>
> On Wed, May 22, 2013 at 7:46 PM, Michael Keselman <
> michael.keselman at gmail.com> wrote:
>
>> Pieter,
>>
>> I tried setting SNDHWM to 0, but the effect is still the same - out of
>> 100,000 messages the subscribers get 40,000-60,000 messages. I also to make
>> sure that messages are not lost when the publisher exits - tried to set
>> linger to a large number and also delayed the publisher exit, but the
>> result is similar. I tried pyzmq with the similar results. I noticed that
>> when the subscriber's delay removed, the subscribers work fine. Feels like
>> something is missing
>>
>>
>> On Tue, May 21, 2013 at 3:30 PM, Pieter Hintjens <ph at imatix.com> wrote:
>>
>>> On Wed, May 22, 2013 at 12:12 AM, Michael Keselman <
>>> michael.keselman at gmail.com> wrote:
>>>
>>>> I tries to increase HWM and also removed it altogether. It is still
>>>> missing messages and results are really inconstant. There is one subscriber
>>>> sending 100,000 messages. With one subscriber, in 3 separate runs
>>>> the subscriber received respectively 76005, 37488, 82121 messages  For 3
>>>> subscribers, the numbers were  34778/34793/35535, 42152/42549/58702,
>>>> 34375/38905/37519 per subscriber per run.
>>>>
>>>
>>> Removing HWM means you use a default of 1,000.
>>>
>>> The number of messages you get will depend on how much CPU the
>>> subscriber can suck to fetch its messages,
>>>
>>> Set the SNDHWM to 0, for example, this means "no limit".
>>>
>>> -Pieter
>>>
>>> _______________________________________________
>>> zeromq-dev mailing list
>>> zeromq-dev at lists.zeromq.org
>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>>
>>>
>>
>>
>> --
>> -Michael Keselman
>>
>> _______________________________________________
>> zeromq-dev mailing list
>> zeromq-dev at lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>>
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>


-- 
-Michael Keselman
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130523/39732b89/attachment.htm>


More information about the zeromq-dev mailing list