[zeromq-dev] large numbers of PUSHers?

[Pieter Hintjens]

You can calculate the network bandwidth needed, and capacity of a
single socket to process perhaps 2-6M messages per second depending on
message size and hardware. You may use multiple IO threads if you're
exceeding 1Gbyte of IO.

I'm impressed you reached 100K connections. It would be fun to
document this as a blog posting.

-Pieter

On Thu, Jun 27, 2013 at 5:14 AM, David Cheney <dcheney at peaxy.net> wrote:
> First, thanks to Pieter for his overnight response to my first Q ("set
> socket opts before bind/connect!") on this list, much appreciated. And
> thanks/grats/props etc to the team who has built ZeroMQ.. I'm new to the
> space but been round long enough to know when to be impressed.
>
> That said, I want to have connect an impressive number of senders to a
> single receiver in a "giant star."   The first question I was asked to look
> into was re limitations that might be imposed by the use of persistent TCP
> connections.  I've looked a bit at the "10k Problem", looked at ulimits,
> managed to build 100K connections to a single PULLer, and seen people
> discussing >1M tcp connections online.
>
> If we assume that messages are small (avg is roughly 512 bytes) and that a
> typical send rate from a single PUSHer is < .25/sec, what ought I to
> consider as next challenges to supporting more PULL side connections?   For
> simplicity I'm still working under the (clearly invalid) assumption that the
> PULLer will always remain available.
>
> Suggestions and pointers much appreciated!
>
> ty,
>
> Dave
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>