[zeromq-dev] exhausting limited FDs

[Brian Smith]

On Wed, May 23, 2012 at 10:45 PM, Chick Corea <chick.zcorea at gmail.com>wrote:

> Then you acknowledge the problem?


Only you can really decide for yourself if it's a problem. There are people
using Zeromq
for which it is not an issue, even well above the scale you mention in your
first post.
Everyone has different limitations. In some cases, no matter how
parsimonious you
are with your CPU and RAM, you'll never be able to reach even 5K clients
per process
anyway.

Even so, if you have ideas about how to improve the FD usage of Zeromq, I
believe the
standard response around here is: Pull requests accepted [gladly]!


> And the recommended solution is to
> increase the FD-max instead of use FDs efficiently.  Something in the
> docs about this particular limit would be helpful since many
> programmers consider CPU and RAM but not FD exhaustion.
>
> Thanks for the clarification.
>

Pull requests for documentation improvements also gladly accepted!
Having such things noted is a pretty good idea. I _think_ it's already on
the wiki, but, noting it specifically in the man pages provides another way
to find the information.


>
> Although I can't help but wonder about what this means for future
> systems (5yrs; 10yrs) in which we might take for granted 1M FDs.  We
> seem to always be trading one set of problems for another.
>

In a future when machines have 256 or more cores, and several hundred
gigs of RAM, figuring out how to use all those resources effectively will be
more challenging than dealing with the number of FDs in use.

-B


>
> CZC
>
> On Wed, May 23, 2012 at 10:06 PM, Pieter Hintjens <ph at imatix.com> wrote:
> > On Wed, May 23, 2012 at 10:02 PM, Chick Corea <chick.zcorea at gmail.com>
> wrote:
> >
> >> What's the solution?   Is that actually acceptable?
> >
> > Raise the per-process FD limits on your machines.
> >
> > -Pieter
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev at lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20120523/342aa382/attachment.htm>