[zeromq-dev] what are the best practices to send complex objects?

Andrzej Dworak Andrzej.Dworak at cern.ch
Tue Jul 17 23:18:04 CEST 2012


Hi,
I did some extensive testing of serialization libraries (tested C++ and Java implementations) more or less 3 months ago. Two products that I liked the most were MessagePack and Google Protocol Buffers. For my case, where I need to have self-describing serialization, I've chosen MessagePack. The requirements were quite high as this is going to be used by one of a core systems at CERN to operate LHC and other accelerators. So far no problems with MP, it's a great product, well, the same as ZeroMQ :)
Cheers,
Andrzej


________________________________
From: zeromq-dev-bounces at lists.zeromq.org [zeromq-dev-bounces at lists.zeromq.org] on behalf of aalok sood [aalok at ideadevice.com]
Sent: 17 July 2012 12:01
To: ZeroMQ development list
Subject: Re: [zeromq-dev] what are the best practices to send complex objects?

If you are **really** concerned about performance, I suggest you have your own protocol that both sides understand.
This way you send data as it is, the remote side would know how to interpret it.



On Tue, Jul 17, 2012 at 3:27 PM, Cem Karan <cfkaran2 at gmail.com<mailto:cfkaran2 at gmail.com>> wrote:
I've been playing with MessagePack (http://msgpack.org/) for serialization and BLOSC (http://blosc.pytables.org/trac) for compression.  They seem to work pretty well together.  How fast is fast?  BLOSC is designed to move data around in memory faster than memcpy() is able to do it, and I haven't had any complaints about how fast MessagePack works (OTOH, I'm I/O bound, so I tend not to hit any limits).

Thanks,
Cem Karan

On Jul 17, 2012, at 3:37 AM, anti_tenzor wrote:

> Hello, all,
>
> I'd like to use ZMQ to send complex objects between applications (using
> CLRZMQ c# wrapper). Since it is possible to send byte[] arrays only,
> I am forced to implement some serialization-deserialization mechanism.
>
> But the hole idea is to be as fast as possible! So it looks like this
> algo should be:
> 1. Extremely fast
> 2. Produce very compact byte arrays
>
> Could you please suggest some best practices or libraries (.net), that
> meets these requirements?
>
> How do you send complex ojects via ZMQ in real-life applications?
>
> Thank you in advance!
>
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev


_______________________________________________
zeromq-dev mailing list
zeromq-dev at lists.zeromq.org<mailto:zeromq-dev at lists.zeromq.org>
http://lists.zeromq.org/mailman/listinfo/zeromq-dev


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.zeromq.org/pipermail/zeromq-dev/attachments/20120717/f82a9c08/attachment.htm>


More information about the zeromq-dev mailing list