[zeromq-dev] Slow subscriber runs out of memory

[a frost]

I think you are right. I have now ported to C and I don't get the memory
increase problem.


On Mon, May 23, 2011 at 11:58 PM, Joshua Foster <jhawk28 at gmail.com> wrote:

> I ported the code to Java and it does not increase in memory. My guess
> is that the clrzmq bindings are at fault.
>
> http://pastebin.com/nZACLqi1
>
> Joshua
>
> On 5/23/2011 11:35 AM, Martin Sustrik wrote:
> > On 05/23/2011 05:17 PM, a frost wrote:
> >
> >> I am evaluating ZMQ, doing some initial testing with a PUB-SUB
> >> configuration. The publisher and subscriber are in separate processes on
> >> the same machine. I am using TCP transport and have set HWM=10 on both
> >> sides.
> >>
> >> The subscriber is slow compared to the publisher and its memory usage
> >> increases rapidly as messages are received from the publisher.
> >>    Eventually, the subscriber process runs out of memory.
> >>
> >> I want messages to be discarded at the subscriber end if it cant process
> >> them fast enough, rather than memory usage increasing without bound as
> >> received messages are buffered. I thought setting HWM on the SUB side
> >> would give me this behaviour, but setting this has no effect on memory
> >> usage.
> > Yes. The messages should be discarded.
> >
> >> Any help would be appreciated. Source code for my test programs is at:
> >>
> >> Publisher: http://pastebin.com/2YtRAi8C
> >> Subscriber: http://pastebin.com/Sr16RP75
> > The programs look OK to me. I guess there is a bug either in 0MQ or
> > jzmq. I wonder if the same thing happens in C (ie. when jzmq is not
> used).
> >
> > Martin
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev at lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20110524/da4e7262/attachment.htm>