[zeromq-dev] Which language binding/API to use such that the process uses least RAM

Pieter Hintjens ph at imatix.com
Tue May 14 23:24:32 CEST 2013


For license, I recommend the C4.1 policy [1] with (L)GPL license.

[1] http://rfc.zeromq.org/spec:22


On Mon, May 13, 2013 at 10:33 PM, gonzalo diethelm <gdiethelm at dcv.cl> wrote:

>  I think zmqc is a GREAT idea; thank you Zachary for the original
> concept, and thank you for placing it in the public domain!!!****
>
> ** **
>
> In order to maximize adoption, I ported zmqc to C; you can find my initial
> version below. This is a raw first cut but it works with my basic (manual)
> unit tests.****
>
> ** **
>
> https://github.com/gonzus/zc****
>
> ** **
>
> I welcome any comments, patches, etc. I would like to license this using
> something like BSD or Apache; can anybody point me to the proper procedure?
> ****
>
> ** **
>
> Thanks,****
>
> ** **
>
> -- ****
>
> Gonzalo Diethelm****
>
> DCV Chile****
>
> ** **
>
> *From:* zeromq-dev-bounces at lists.zeromq.org [mailto:
> zeromq-dev-bounces at lists.zeromq.org] *On Behalf Of *A. Mark
> *Sent:* Thursday, April 04, 2013 10:23 PM
>
> *To:* ZeroMQ development list
> *Subject:* Re: [zeromq-dev] Which language binding/API to use such that
> the process uses least RAM****
>
>  ** **
>
> There are a couple such bindings:
>
> http://www.zeromq.org/bindings:bash****
>
> ** **
>
> On Thu, Apr 4, 2013 at 3:50 PM, Joshua Foster <jhawk28 at gmail.com> wrote:**
> **
>
> You can use something like ZMQC.
>
> Here is a python version: https://github.com/zacharyvoase/zmqc
> Here is my go "port" of it: https://github.com/jhawk28/zmqc
>
> Joshua
>
>
> ****
>
> ****
>
> *Arvind Creatrix IT Soft* <arvind at creatrixitsoft.com>****
>
> Thursday, April 04, 2013 5:52 PM****
>
> Hello,****
>
>  ****
>
> Thank you for your helpful replies.****
>
>  ****
>
> One final query- can i access zeromq to send messages from shell scripts
> (Linux) and Command Line scripts(Windows)? That is what I would prefer to
> do- however I dont know if its possible.****
>
>  ****
>
> Yours sincerely,
> Arvind,
> Creatrix IT Soft.****
>
>  ****
>
> *From:* A. Mark <gougolith at gmail.com> ****
>
> *Sent:* Friday, April 5, 2013 12:19 AM****
>
> *To:* ZeroMQ development list <zeromq-dev at lists.zeromq.org> ****
>
> *Subject:* Re: [zeromq-dev] Which language binding/API to use such that
> the process uses least RAM****
>
>  ****
>
> ZMQ's memory utilization while messaging will - among other things -
> depend on the zmq socket options and how you implement messaging. It sounds
> like you are going to be exchanging small messages and not transferring
> very large chunks, you should be able to reduce memory usage of zmq. My
> first guess is tuning SND/RCVBUF SND/RCVHWM  zmq socket options and using
> zmq_recv/zmq_send calls if you are very concerned and want the lowest
> memory usage.****
>
> ** **
>
>  ****
>   ------------------------------
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> ****
>
> *A. Mark* <gougolith at gmail.com>****
>
> Thursday, April 04, 2013 2:49 PM****
>
> ZMQ's memory utilization while messaging will - among other things -
> depend on the zmq socket options and how you implement messaging. It sounds
> like you are going to be exchanging small messages and not transferring
> very large chunks, you should be able to reduce memory usage of zmq. My
> first guess is tuning SND/RCVBUF SND/RCVHWM  zmq socket options and using
> zmq_recv/zmq_send calls if you are very concerned and want the lowest
> memory usage.****
>
>
>
> ****
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> ****
>
> *Arvind Creatrix IT Soft* <arvind at creatrixitsoft.com>****
>
> Thursday, April 04, 2013 12:25 PM****
>
> Hi****
>
>  ****
>
> I am building a platform for deploying apps to cloud- I wish to use a
> mechanism for monitoring metrics of servers running apps for which I am
> considering zeromq- but one concern is the amount of RAM/CPU utilised by
> the process that sends data to monitoring server via ZeroMQ-  since the
> machine (where this process is running) itself may have as low as 512MB
> RAM(or less) and the client’s app will be running on this machine as well.
> Hence I want the process that sends messages via ZeroMQ to use as less
> RAM/CPU as possible.****
>
>  ****
>
> Yours sincerely,
> Arvind,
> Creatrix IT Soft.****
>
>  ****
>
> *From:* Sean Ochoa <sean.m.ochoa at gmail.com> ****
>
> *Sent:* Thursday, April 4, 2013 9:24 PM****
>
> *To:* ZeroMQ development list <zeromq-dev at lists.zeromq.org> ****
>
> *Subject:* Re: [zeromq-dev] Which language binding/API to use such that
> the process uses least RAM****
>
>  ****
>
> Arvind, ****
>
> ** **
>
> RAM/CPU usage will be consistently low using ZeroMQ using either java or
> python (both can run on linux & windows).  ****
>
> ** **
>
> The memory footprint of the process really depends on the implementation.
> I know that, using python, I can serialize and compress a dictionary (aka
> "unordered map") using pickle (object serializer) and zlib (for keeping
> payload size small) and send it over the wire via ZeroMQ without any sort
> of memory or CPU concerns.  ****
>
> ** **
>
> However, I don't think that this is the right way to do this kind of
> performance monitoring.  Both Windoze and Linux variants have tools or
> mechanisms built-in to the OS to do performance monitoring on a process.
> For windows, you would want to use WMI<http://technet.microsoft.com/en-us/library/cc767879.aspx>.
> For Linux, you'd want to use command line tools that are available<http://www.cyberciti.biz/tips/top-linux-monitoring-tools.html>
> .****
>
> ** **
>
> What's the real problem you're trying to solve here?****
>
> ** **
>
> -- Sean****
>
>
>
>
>
> ****
>
>  ****
>
> --
> Sean | (206) 962-7954 ** **
>   ------------------------------
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> ****
>
> *Sean Ochoa* <sean.m.ochoa at gmail.com>****
>
> Thursday, April 04, 2013 11:54 AM****
>
> Arvind, ****
>
> ** **
>
> RAM/CPU usage will be consistently low using ZeroMQ using either java or
> python (both can run on linux & windows).  ****
>
> ** **
>
> The memory footprint of the process really depends on the implementation.
>  I know that, using python, I can serialize and compress a dictionary (aka
> "unordered map") using pickle (object serializer) and zlib (for keeping
> payload size small) and send it over the wire via ZeroMQ without any sort
> of memory or CPU concerns.  ****
>
> ** **
>
> However, I don't think that this is the right way to do this kind of
> performance monitoring.  Both Windoze and Linux variants have tools or
> mechanisms built-in to the OS to do performance monitoring on a process.
>  For windows, you would want to use WMI<http://technet.microsoft.com/en-us/library/cc767879.aspx>.
>  For Linux, you'd want to use command line tools that are available<http://www.cyberciti.biz/tips/top-linux-monitoring-tools.html>
> .****
>
> ** **
>
> What's the real problem you're trying to solve here?****
>
> ** **
>
> -- Sean****
>
>
>
>
>
> ****
>
> ** **
>
> --
> Sean | (206) 962-7954 ** **
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> ****
>
> *Arvind Creatrix IT Soft* <arvind at creatrixitsoft.com>****
>
> Wednesday, April 03, 2013 5:11 PM****
>
>  ****
>
> Hi****
>
>  ****
>
> I wish to create a simple process that basically measures the CPU/RAM
> utilisated by a running process on that server, and sends it via ZeroMQ.**
> **
>
> With the multiple language bindings available for ZeroMQ, I wish to use
> that language(for utilising ZeroMQ)- that uses the least possible RAM. And
> ideally I can compile/create the ready to run process on my machine, and
> then run it on any OS(including Linux—> Ubuntu/CentOS and Windows) and for
> different types of RAM/CPU configurations. I understand that ZeroMQ core
> will have to be installed/made available for use by my process.****
>
>  ****
>
> Any insights intot ****
>
> Yours sincerely,
> Arvind,
> Creatrix IT Soft.****
>
>  ****
>
> *From:* Felipe Cruz <felipecruz at loogica.net> ****
>
> *Sent:* Thursday, April 4, 2013 2:34 AM****
>
> *To:* ZeroMQ development list <zeromq-dev at lists.zeromq.org> ****
>
> *Subject:* Re: [zeromq-dev] czmq - Timer returning -1 don't finish zloop**
> **
>
>  ****
>
> I got tricked by an old revision.. this is already fixed:
> https://github.com/zeromq/czmq/issues/113 ****
>
>  ****
>
> regards,****
>
>
>
>
>
> ****
>
>  ****
>
> -- ****
>
> Felipe Cruz****
>
> http://about.me/felipecruz****
>    ------------------------------
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev****
>
> ** **
>
> ------------------------------
>
> Declaración de confidencialidad: Este Mensaje esta destinado para el uso
> de la o las personas o entidades a quien ha sido dirigido y puede contener
> información reservada y confidencial que no puede ser divulgada, difundida,
> ni aprovechada en forma alguna. El uso no autorizado de la información
> contenida en este correo podrá ser sancionado de conformidad con la ley
> chilena. Si usted ha recibido este correo electrónico por error, le pedimos
> eliminarlo junto con los archivos adjuntos y avisar inmediatamente al
> remitente, respondiendo este mensaje. Disclosure: This Message is to be
> used by the individual, individuals or entities that it is addressed to and
> may include private and confidential information that may not be disclosed,
> made public nor used in any way at all. Unauthorized use of the information
> in this electronic mail message may be subject to the penalties set forth
> by Chilean law. If you have received this electronic mail message in error,
> we ask you to destroy the message and its attached file(s) and to
> immediately notify the sender by answering this message.
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130514/b6c9fba6/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 770 bytes
Desc: not available
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130514/b6c9fba6/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 1086 bytes
Desc: not available
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20130514/b6c9fba6/attachment-0001.jpg>


More information about the zeromq-dev mailing list