[zeromq-dev] dynamically named workers, router/dealer?

[Admir Efendic]

Thanks Pieter, and you are absolutely right, I had to ask though, in case
it was the matter of "you just do XYZ and voila" ;)



2013/8/5 Pieter Hintjens <ph at imatix.com>

> Hi Admir,
>
> Just general advice; if this is your first app using ZeroMQ, set it
> aside and spend a few days learning various patterns, especially the
> Router-based ones in the Guide. Then build up a minimal design to your
> problem keeping it as simple as you can, and grow that as you learn
> more about it. Your upfront design process is almost always going to
> be wrong, unless you're doing it a second time.
>
> -Pieter
>
> On Mon, Aug 5, 2013 at 10:51 AM, Admir Efendic <admir.efendic at gmail.com>
> wrote:
> > Hello!
> >
> > I am writing a small load testing tool in python for a payment solutions
> > company, where I'm basically parsing logs containing incoming xmlrpc
> calls
> > from various e-stores. There are maybe 10.000+ e-stores, and for
> arguments
> > sake we can say that maybe 100 of them may be active concurrently and
> > sending requests to the server.
> >
> > Each e-store is identified by an ID.
> >
> > So what I am doing is parsing the logs, extracting the calls and
> timestamps,
> > and replaying the same traffic patterns in 1.0x speed, or any other speed
> > factor. I would also like to simulate the connection dynamics so that
> every
> > active e-store has its own connection.
> >
> > Since there can be 10.000 e-stores, I would like to reuse say 100 worker
> > threads in a pool, where each thread would be assigned an e-store ID,
> and if
> > it has been idle for a while it could get assigned a new one.
> >
> > The router process should be able to set e-store ID for a thread that has
> > been idle for a certain amount of time and route it that way.
> >
> > I'm fumbling a bit regarding which socket type to use, and how to set
> the ID
> > on the fly, and I'm wondering if anyone has any ideas and if what I wrote
> > makes any sense so far :)
> >
> > Regards,
> > /Adde
> >
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev at lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> >
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130805/034a19d1/attachment.htm>