[zeromq-dev] Which language binding/API to use such that the process uses least RAM

Mon May 13 22:33:38 CEST 2013

I think zmqc is a GREAT idea; thank you Zachary for the original concept, and thank you for placing it in the public domain!!!

In order to maximize adoption, I ported zmqc to C; you can find my initial version below. This is a raw first cut but it works with my basic (manual) unit tests.

https://github.com/gonzus/zc

I welcome any comments, patches, etc. I would like to license this using something like BSD or Apache; can anybody point me to the proper procedure?

Thanks,

--
Gonzalo Diethelm
DCV Chile

From: zeromq-dev-bounces at lists.zeromq.org [mailto:zeromq-dev-bounces at lists.zeromq.org] On Behalf Of A. Mark
Sent: Thursday, April 04, 2013 10:23 PM
To: ZeroMQ development list
Subject: Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

There are a couple such bindings:

http://www.zeromq.org/bindings:bash

On Thu, Apr 4, 2013 at 3:50 PM, Joshua Foster <jhawk28 at gmail.com<mailto:jhawk28 at gmail.com>> wrote:
You can use something like ZMQC.

Here is a python version: https://github.com/zacharyvoase/zmqc
Here is my go "port" of it: https://github.com/jhawk28/zmqc

Joshua

[cid:image001.jpg at 01CE4FF7.606521C0]
Arvind Creatrix IT Soft<mailto:arvind at creatrixitsoft.com>
Thursday, April 04, 2013 5:52 PM
Hello,

Thank you for your helpful replies.

One final query- can i access zeromq to send messages from shell scripts (Linux) and Command Line scripts(Windows)? That is what I would prefer to do- however I dont know if its possible.

Yours sincerely,
Arvind,
Creatrix IT Soft.

From: A. Mark<mailto:gougolith at gmail.com>
Sent: Friday, April 5, 2013 12:19 AM
To: ZeroMQ development list<mailto:zeromq-dev at lists.zeromq.org>
Subject: Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

ZMQ's memory utilization while messaging will - among other things - depend on the zmq socket options and how you implement messaging. It sounds like you are going to be exchanging small messages and not transferring very large chunks, you should be able to reduce memory usage of zmq. My first guess is tuning SND/RCVBUF SND/RCVHWM  zmq socket options and using zmq_recv/zmq_send calls if you are very concerned and want the lowest memory usage.

________________________________
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[cid:image001.jpg at 01CE4FF7.606521C0]
A. Mark<mailto:gougolith at gmail.com>
Thursday, April 04, 2013 2:49 PM
ZMQ's memory utilization while messaging will - among other things - depend on the zmq socket options and how you implement messaging. It sounds like you are going to be exchanging small messages and not transferring very large chunks, you should be able to reduce memory usage of zmq. My first guess is tuning SND/RCVBUF SND/RCVHWM  zmq socket options and using zmq_recv/zmq_send calls if you are very concerned and want the lowest memory usage.

_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[cid:image001.jpg at 01CE4FF7.606521C0]
Arvind Creatrix IT Soft<mailto:arvind at creatrixitsoft.com>
Thursday, April 04, 2013 12:25 PM
Hi

I am building a platform for deploying apps to cloud- I wish to use a mechanism for monitoring metrics of servers running apps for which I am considering zeromq- but one concern is the amount of RAM/CPU utilised by the process that sends data to monitoring server via ZeroMQ-  since the machine (where this process is running) itself may have as low as 512MB RAM(or less) and the client's app will be running on this machine as well. Hence I want the process that sends messages via ZeroMQ to use as less RAM/CPU as possible.

Yours sincerely,
Arvind,
Creatrix IT Soft.

From: Sean Ochoa<mailto:sean.m.ochoa at gmail.com>
Sent: Thursday, April 4, 2013 9:24 PM
To: ZeroMQ development list<mailto:zeromq-dev at lists.zeromq.org>
Subject: Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

Arvind,

RAM/CPU usage will be consistently low using ZeroMQ using either java or python (both can run on linux & windows).

The memory footprint of the process really depends on the implementation.  I know that, using python, I can serialize and compress a dictionary (aka "unordered map") using pickle (object serializer) and zlib (for keeping payload size small) and send it over the wire via ZeroMQ without any sort of memory or CPU concerns.

However, I don't think that this is the right way to do this kind of performance monitoring.  Both Windoze and Linux variants have tools or mechanisms built-in to the OS to do performance monitoring on a process.  For windows, you would want to use WMI<http://technet.microsoft.com/en-us/library/cc767879.aspx>.  For Linux, you'd want to use command line tools that are available<http://www.cyberciti.biz/tips/top-linux-monitoring-tools.html>.

What's the real problem you're trying to solve here?

-- Sean

--
Sean | (206) 962-7954<tel:%28206%29%20962-7954>
________________________________
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[cid:image002.jpg at 01CE4FF7.606521C0]
Sean Ochoa<mailto:sean.m.ochoa at gmail.com>
Thursday, April 04, 2013 11:54 AM
Arvind,

RAM/CPU usage will be consistently low using ZeroMQ using either java or python (both can run on linux & windows).

The memory footprint of the process really depends on the implementation.  I know that, using python, I can serialize and compress a dictionary (aka "unordered map") using pickle (object serializer) and zlib (for keeping payload size small) and send it over the wire via ZeroMQ without any sort of memory or CPU concerns.

However, I don't think that this is the right way to do this kind of performance monitoring.  Both Windoze and Linux variants have tools or mechanisms built-in to the OS to do performance monitoring on a process.  For windows, you would want to use WMI<http://technet.microsoft.com/en-us/library/cc767879.aspx>.  For Linux, you'd want to use command line tools that are available<http://www.cyberciti.biz/tips/top-linux-monitoring-tools.html>.

What's the real problem you're trying to solve here?

-- Sean

--
Sean | (206) 962-7954<tel:%28206%29%20962-7954>
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[cid:image001.jpg at 01CE4FF7.606521C0]
Arvind Creatrix IT Soft<mailto:arvind at creatrixitsoft.com>
Wednesday, April 03, 2013 5:11 PM

Hi

I wish to create a simple process that basically measures the CPU/RAM utilisated by a running process on that server, and sends it via ZeroMQ.
With the multiple language bindings available for ZeroMQ, I wish to use that language(for utilising ZeroMQ)- that uses the least possible RAM. And ideally I can compile/create the ready to run process on my machine, and then run it on any OS(including Linux-> Ubuntu/CentOS and Windows) and for different types of RAM/CPU configurations. I understand that ZeroMQ core will have to be installed/made available for use by my process.

Any insights intot
Yours sincerely,
Arvind,
Creatrix IT Soft.

From: Felipe Cruz<mailto:felipecruz at loogica.net>
Sent: Thursday, April 4, 2013 2:34 AM
To: ZeroMQ development list<mailto:zeromq-dev at lists.zeromq.org>
Subject: Re: [zeromq-dev] czmq - Timer returning -1 don't finish zloop

I got tricked by an old revision.. this is already fixed: https://github.com/zeromq/czmq/issues/113

regards,

--
Felipe Cruz
http://about.me/felipecruz
________________________________
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

----------------------------------------- 
Declaración de confidencialidad: Este Mensaje esta destinado para
el uso de la o las personas o entidades a quien ha sido dirigido y
puede contener información reservada y confidencial que no puede
ser divulgada, difundida, ni aprovechada en forma alguna. El uso no
autorizado de la información contenida en este correo podrá ser
sancionado de conformidad con la ley chilena. 
Si usted ha recibido este correo electrónico por error, le pedimos
eliminarlo junto con los archivos adjuntos y avisar inmediatamente
al remitente, respondiendo este mensaje. 

"Before printing this e-mail think if is really necesary".
Disclosure: This Message is to be used by the individual,
individuals or entities that it is addressed to and may include
private and confidential information that may not be disclosed,
made public nor used in any way at all. Unauthorized use of the
information in this electronic mail message may be subject to the
penalties set forth by Chilean law. 
If you have received this electronic mail message in error, we ask
you to destroy the message and its attached file(s) and to
immediately notify the sender by answering this message. 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130513/058a0260/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 770 bytes
Desc: image001.jpg
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130513/058a0260/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 1086 bytes
Desc: image002.jpg
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130513/058a0260/attachment-0001.jpg>