[zeromq-dev] pyzmq poller performance

[Brian Knox]

Thanks Min - additionally if I'm incorrect in my assumption that the poll
look in my example code should perform better, or if there's a better way
to do what I'm doing just let me know.

The example code polls only one socket (which isn't that useful, hah) but I
wanted to keep the test case dirt simple.  The actual thing I was working
on has one socket that should receive data at a relatively high rate (say
50k to 100k msgs/s)  , and one socket that receives data at a much lower
rate (say 1 msg/s) (for heartbeating, command and control, etc).


Brian


On Mon, Jun 24, 2013 at 12:12 PM, Min RK <benjaminrk at gmail.com> wrote:

> Thanks for the report, I will look into whether I have introduced a
> performance degradation in the last few  iterations.
>
> -MinRK
>
> On Jun 24, 2013, at 11:27, Brian Knox <briank at talksum.com> wrote:
>
> > It's been awhile since I've used pyzmq, and I'm running into a
> performance issue using Poller.poll().
> >
> > With a simple blocking recv() in a while True loop, I get ~ 300k
> messages a second.
> >
> > With the simplest case of the same code using a poll on the socket, I
> get ~ 30k messages a second.
> >
> > (pyzeromq)taotetek at Moya:~/src/performance_example$ python ./receiver.py
> > mps: 226049
> > mps: 348582
> > mps: 271728
> > mps: 300389
> > mps: 411059
> > mps: 276749
> >
> > (pyzeromq)taotetek at Moya:~/src/performance_example$ python
> ./poll_receiver.py
> > mps: 28066
> > mps: 28116
> > mps: 29745
> > mps: 28912
> > mps: 28679
> >
> > I don't remember a 10x performance degradation last time I used a poller
> - but perhaps I'm remembering something wrong, or making a painfully
> obvious error in my code .. I've been using czmq from C mostly for the last
> while.
> >
> > I'm using pyzmq from git master, and the latest Cython (0.19.1) with
> libzmq 3.2.3.
> >
> > I've attached the test cases I'm using.
> >
> > <performance_example.tar>
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev at lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130624/e4a806c8/attachment.htm>