[zeromq-dev] architecture performance issues

[Michael Holm]

Try using PGM or EPGM instead of TCP/IP.

Also think about adding a topic to each message and allow 0MQ to filter for you.

When you start to have scaling problems is when multicast becomes helpful. It also depends what you are trying to do and how many vlans you are crossing.

I ran some tests and found that EPGM performs better than TCP/IP once you reach ten clients located on a different machine.

$.02

From: zeromq-dev-bounces at lists.zeromq.org [mailto:zeromq-dev-bounces at lists.zeromq.org] On Behalf Of Andrew Hume
Sent: 20 May 2011 10:19
To: ZeroMQ development list
Subject: [zeromq-dev] architecture performance issues

i think i need to rework some of my architecture because its not scaling
like i need it to.

what is have is 80 processes spread evenly across 8 servers producing output
for a configurable number (say 30) of receiver processes. each message produced
has a marker on it, and all messages with the same tag must go to the
same receiver process (this is to do deduping).

i wanted to avoid each receiver opening up 80 sockets and vice versa,
so i set up (essentially) a forwarder device, one per server,
so that the 80 processes now just open 8 sockets each,
an dthe receiver processes are now anonymous and just connect to
the forwarder on their node.

this doesn't scale becaus ethe forwarder gets too loaded.
right now, i use pub/sub, but would rather use push/pull.

any sggestions on how else i might do it?

------------------
Andrew Hume  (best -> Telework) +1 623-551-2845
andrew at research.att.com<mailto:andrew at research.att.com>  (Work) +1 973-236-2014
AT&T Labs - Research; member of USENIX and LOPSA





Tibra Trading Europe Limited is Authorised and Regulated by the FSA (Company No. 06061713)
Tibra Global Services Pty Limited London Branch (Company No. BR014370)
Tibra Equities Europe Limited (Company No. 07283912)
Registered in England & Wales - Level 11, 5 Aldermanbury Square London EC2V 7HR

The contents of this email including any attachments are confidential. If you have received this email in error, please advise the sender by return email and delete this email. Any unauthorised use of the contents of the email is prohibited and you must not disseminate, copy or distribute the message or use the information contained in the email or its attachments in any way.

The views or opinions expressed are the author's own and may not reflect the views or opinions of Tibra. Tibra does not guarantee the integrity of any emails or attached files. E-mails may be interfered with, may contain computer viruses or other defects. Under no circumstances do we accept liability for any loss or damage which may result from your receipt of this message or any attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20110520/d10cfb88/attachment.htm>