[zeromq-dev] push/pull mongodb

Christian Schulz mining.facts at gmail.com
Wed Jul 3 20:02:44 CEST 2013


Hi,

usually push/pull works great for my parallelization tasks ( fast cursor 
and slower computing (pull workers)).
In one case I have a mongodb *sorted* cursor to push. The  pull part 
doing some stuff and finally update
data back to mongodb.

  collection.update({'anyid':anyid},
                                         {
                                             '$set':{'last':ts,}
'$setOnInsert':{'first':ts},
                                              ......
                                         },upsert=True)

No surprise , last could be earlier then first, because the workers are 
not synchronised what makes them fast.
Is there a way in zeromq to overcome with this problem , naturally with 
some speed loss?

many thanks
Christian



More information about the zeromq-dev mailing list