[zeromq-dev] rc == 0 (./zmq/mutex.hpp:94)

Aamir M aamirjvm at gmail.com
Mon Jul 13 19:02:28 CEST 2009 

Attachment was scrubbed out. Resending.

On Mon, Jul 13, 2009 at 12:59 PM, Aamir M<aamirjvm at gmail.com> wrote:
> I don't know if I'm on the right track, but I think I've collected
> further evidence that the mutex is being locked before it's
> initialized. I am printing the mutex memory addresses in the following
> way:
>
>        inline mutex_t ()
>        {
>            int rc = pthread_mutex_init (&mutex, NULL);
>            printf("0MQ MUTEX INIT: %p\n", (void*)&mutex);
>            if (rc)
>                posix_assert (rc);
>        }
>
>        inline void lock ()
>        {
>            int rc = pthread_mutex_lock (&mutex);
>            printf("0MQ LOCK: %p\n", (void*)&mutex);
>            if (rc)
>            {
>                printf("0MQ BROKEN LOCK: %p\n", (void*)&mutex);
>                posix_assert (rc);
>            }
>        }
>
> Output text log is attached. The log shows that the "0MQ INIT" print
> statement always outputs before a successful lock (as expected). And
> whenever an unsuccessful lock occurs ("0MQ BROKEN LOCK") the
> constructor "0MQ INIT" is never printed for that memory address (which
> probably means that the mutex object was never initialized). Another
> interesting thing is that the offending mutex lock occurs twice on the
> same mutex object (presumably corresponding to my two receiver
> threads).
>
> The puzzle for me is whether the bug is due to me incorrectly using
> the 0MQ library, or whether something more sinister is happening
> inside the library.
>
> Thanks again.
>
> Aamir
>
> On Mon, Jul 13, 2009 at 12:14 PM, Martin Hurton<hurtonm at gmail.com> wrote:
>> Hi Aamir,
>>
>> What OS are you running your application on? And what thread library
>> are you using?
>>
>> Regards,
>> Martin
>>
>>
>> On Mon, Jul 13, 2009 at 5:48 PM, Aamir M<aamirjvm at gmail.com> wrote:
>>> I think I've narrowed down the cause of the error to one specific
>>> messaging mechanism in our application ...
>>>
>>> I have a process-scope exchange and two threads with local-scope
>>> queues receiving messages from the exchange. We started seeing the
>>> error when we changed the process-scope exchange from load-balancing
>>> style to data-distribution style. The error seems to go away if we we
>>> turn off the receiver threads or switch it back to load-balancing.
>>>
>>> Thanks,
>>> Aamir
>>>
>>> On Mon, Jul 13, 2009 at 11:32 AM, Martin Hurton<hurtonm at gmail.com> wrote:
>>>> Hi Aamir,
>>>>
>>>> Please apply the attached patch to 0.6.1 tree and let us know what's
>>>> printed when the assertion fails.
>>>>
>>>> Regards,
>>>> Martin
>>>>
>>>> On Mon, Jul 13, 2009 at 4:36 PM, Aamir M<aamirjvm at gmail.com> wrote:
>>>>> Hello,
>>>>>
>>>>> We have a somewhat large/complex multi-threaded program that makes
>>>>> heavy use of 0MQ for both process-scope and network-scope messaging.
>>>>> Recently we implemented some changes and started seeing the following
>>>>> error:
>>>>>
>>>>> Success
>>>>> rc == 0 (./zmq/mutex.hpp:94)
>>>>> Aborted
>>>>>
>>>>> 0MQ is asserting on ./zmq/mutex.hpp:94 and aborting the program.
>>>>> Before the 0MQ assert occurs, some other function is causing the word
>>>>> "Success" to be printed onto the screen.
>>>>>
>>>>> What could be causing this problem? It is proving very difficult to
>>>>> debug this error because I have no idea which line triggers the
>>>>> problem. Like any other bug related to a multi-threaded race
>>>>> condition, the difficultly is compounded by the fact that the error
>>>>> only occurs SOME of the time (i.e. it cannot be deterministically
>>>>> reproduced).
>>>>>
>>>>> Does anyone have any ideas on how to isolate the offending code? When
>>>>> does 0MQ use this pthread mutex and how could this assert happen while
>>>>> sending / receiving messages?
>>>>>
>>>>> We have been careful to make sure that threads never share the same
>>>>> zmq_api object ... each thread has its own instance of zmq_api, so I
>>>>> don't think this could be the problem.
>>>>>
>>>>> Thanks,
>>>>> Aamir
>>>>> _______________________________________________
>>>>> zeromq-dev mailing list
>>>>> zeromq-dev at lists.zeromq.org
>>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
[ RUN      ] zmq.test
0MQ MUTEX INIT: 0x10030aa8
0MQ MUTEX INIT: 0x10030b50
0MQ MUTEX INIT: 0x10030bc8
0MQ MUTEX INIT: 0x10030c40
0MQ MUTEX INIT: 0x10030cb8
0MQ MUTEX INIT: 0x10030d30
0MQ MUTEX INIT: 0x10030da8
0MQ MUTEX INIT: 0x10030e20
0MQ MUTEX INIT: 0x10030e98
0MQ MUTEX INIT: 0x10030f10
0MQ MUTEX INIT: 0x10030f88
0MQ MUTEX INIT: 0x10031000
0MQ MUTEX INIT: 0x10031078
0MQ MUTEX INIT: 0x100310f0
0MQ MUTEX INIT: 0x10031168
0MQ MUTEX INIT: 0x100311e0
0MQ MUTEX INIT: 0x10031258
0MQ MUTEX INIT: 0x100312d0
0MQ MUTEX INIT: 0x10031348
0MQ MUTEX INIT: 0x100313c0
0MQ MUTEX INIT: 0x10031438
0MQ MUTEX INIT: 0x100314b0
0MQ MUTEX INIT: 0x10031528
0MQ MUTEX INIT: 0x100315a0
0MQ MUTEX INIT: 0x10031618
0MQ MUTEX INIT: 0x10031690
0MQ MUTEX INIT: 0x10031708
0MQ MUTEX INIT: 0x10031780
0MQ MUTEX INIT: 0x100317f8
0MQ MUTEX INIT: 0x10031870
0MQ MUTEX INIT: 0x100318e8
0MQ MUTEX INIT: 0x10031960
0MQ MUTEX INIT: 0x100319d8
0MQ MUTEX INIT: 0x10031a50
0MQ MUTEX INIT: 0x10031ac8
0MQ MUTEX INIT: 0x10031b40
0MQ MUTEX INIT: 0x10031bb8
0MQ MUTEX INIT: 0x10031c30
0MQ MUTEX INIT: 0x10031ca8
0MQ MUTEX INIT: 0x10031d20
0MQ MUTEX INIT: 0x10031d98
0MQ MUTEX INIT: 0x10031e10
0MQ MUTEX INIT: 0x10031e88
0MQ MUTEX INIT: 0x10031f00
0MQ MUTEX INIT: 0x10031f78
0MQ MUTEX INIT: 0x10031ff0
0MQ MUTEX INIT: 0x10032068
0MQ MUTEX INIT: 0x100320e0
0MQ MUTEX INIT: 0x10032158
0MQ MUTEX INIT: 0x100321d0
0MQ MUTEX INIT: 0x10032248
0MQ MUTEX INIT: 0x100322c0
0MQ MUTEX INIT: 0x10032338
0MQ MUTEX INIT: 0x100323b0
0MQ MUTEX INIT: 0x10032428
0MQ MUTEX INIT: 0x100324a0
0MQ MUTEX INIT: 0x10032518
0MQ MUTEX INIT: 0x10032590
0MQ MUTEX INIT: 0x10032608
0MQ MUTEX INIT: 0x10032680
0MQ MUTEX INIT: 0x100326f8
0MQ MUTEX INIT: 0x10032770
0MQ MUTEX INIT: 0x100327e8
0MQ MUTEX INIT: 0x10032860
0MQ MUTEX INIT: 0x100328d8
0MQ MUTEX INIT: 0x10032950
0MQ MUTEX INIT: 0x100329c8
0MQ MUTEX INIT: 0x10032a40
0MQ MUTEX INIT: 0x10032ab8
0MQ MUTEX INIT: 0x10032b30
0MQ MUTEX INIT: 0x10032ba8
0MQ MUTEX INIT: 0x10032c20
0MQ MUTEX INIT: 0x10032c98
0MQ MUTEX INIT: 0x10032d10
0MQ MUTEX INIT: 0x10032d88
0MQ MUTEX INIT: 0x10032e00
0MQ MUTEX INIT: 0x10032e78
0MQ MUTEX INIT: 0x10032ef0
0MQ MUTEX INIT: 0x10032f68
0MQ MUTEX INIT: 0x10032fe0
0MQ MUTEX INIT: 0x10033058
0MQ MUTEX INIT: 0x100330d0
0MQ MUTEX INIT: 0x10040228
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030bc8
0MQ LOCK: 0x10030bc8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ MUTEX INIT: 0x10041148
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ MUTEX INIT: 0x10041328
0MQ LOCK: 0x100317f8
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x10031a50
0MQ MUTEX INIT: 0x10045018
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x100327e8
0MQ LOCK: 0x100327e8
0MQ LOCK: 0x10030aa8
0MQ MUTEX INIT: 0x100459b8
0MQ LOCK: 0x100324a0
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10041328
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10040228
0MQ LOCK: 0x100317f8
0MQ LOCK: 0x100324a0
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10045018
0MQ MUTEX INIT: 0x40008000f78
0MQ MUTEX INIT: 0x40008001070
0MQ MUTEX INIT: 0x400080010e8
0MQ MUTEX INIT: 0x40008001160
0MQ MUTEX INIT: 0x400080011d8
0MQ MUTEX INIT: 0x40008001250
0MQ MUTEX INIT: 0x400080012c8
0MQ MUTEX INIT: 0x40008001340
0MQ MUTEX INIT: 0x400080013b8
0MQ MUTEX INIT: 0x40008001430
0MQ MUTEX INIT: 0x400080014a8
0MQ MUTEX INIT: 0x40008001520
0MQ MUTEX INIT: 0x40008001598
0MQ MUTEX INIT: 0x40008001610
0MQ MUTEX INIT: 0x40008001688
0MQ MUTEX INIT: 0x40008001700
0MQ MUTEX INIT: 0x40008001778
0MQ MUTEX INIT: 0x400080017f0
0MQ MUTEX INIT: 0x40008001868
0MQ MUTEX INIT: 0x400080018e0
0MQ MUTEX INIT: 0x40008001958
0MQ MUTEX INIT: 0x400080019d0
0MQ MUTEX INIT: 0x40008001a48
0MQ MUTEX INIT: 0x40008001ac0
0MQ MUTEX INIT: 0x40008001b38
0MQ MUTEX INIT: 0x40008001bb0
0MQ MUTEX INIT: 0x40008001c28
0MQ MUTEX INIT: 0x40008001ca0
0MQ MUTEX INIT: 0x40008001d18
0MQ MUTEX INIT: 0x40008001d90
0MQ MUTEX INIT: 0x40008001e08
0MQ MUTEX INIT: 0x40008001e80
0MQ MUTEX INIT: 0x40008001ef8
0MQ MUTEX INIT: 0x40008001f70
0MQ MUTEX INIT: 0x40008001fe8
0MQ MUTEX INIT: 0x40008002060
0MQ MUTEX INIT: 0x400080020d8
0MQ MUTEX INIT: 0x40008002150
0MQ MUTEX INIT: 0x400080021c8
0MQ MUTEX INIT: 0x40008002240
0MQ MUTEX INIT: 0x400080022b8
0MQ MUTEX INIT: 0x40008002330
0MQ MUTEX INIT: 0x400080023a8
0MQ MUTEX INIT: 0x40008002420
0MQ MUTEX INIT: 0x40008002498
0MQ MUTEX INIT: 0x40008002510
0MQ MUTEX INIT: 0x40008002588
0MQ MUTEX INIT: 0x40008002600
0MQ MUTEX INIT: 0x40008002678
0MQ MUTEX INIT: 0x400080026f0
0MQ MUTEX INIT: 0x40008002768
0MQ MUTEX INIT: 0x400080027e0
0MQ MUTEX INIT: 0x40008002858
0MQ MUTEX INIT: 0x400080028d0
0MQ MUTEX INIT: 0x40008002948
0MQ MUTEX INIT: 0x400080029c0
0MQ MUTEX INIT: 0x40008002a38
0MQ MUTEX INIT: 0x40008002ab0
0MQ MUTEX INIT: 0x40008002b28
0MQ MUTEX INIT: 0x40008002ba0
0MQ MUTEX INIT: 0x40008002c18
0MQ MUTEX INIT: 0x40008002c90
0MQ MUTEX INIT: 0x40008002d08
0MQ MUTEX INIT: 0x40008002d80
0MQ MUTEX INIT: 0x40008002df8
0MQ LOCK: 0x40008000f78
0MQ MUTEX INIT: 0x10049048
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008001430
0MQ MUTEX INIT: 0x10052678
0MQ LOCK: 0x40008001430
0MQ LOCK: 0x40008001430
0MQ MUTEX INIT: 0x10055788
0MQ LOCK: 0x10049048
0MQ LOCK: 0x10032ba8
0MQ LOCK: 0x10045018
0MQ LOCK: 0x40008001430
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10032ba8
0MQ LOCK: 0x10052678
0MQ LOCK: 0x10055788
0MQ LOCK: 0x10045018
0MQ LOCK: 0x40008000f78
0MQ MUTEX INIT: 0x10058b08
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008001ca0
0MQ MUTEX INIT: 0x10061318
0MQ LOCK: 0x100321d0
0MQ LOCK: 0x10041148
0MQ MUTEX INIT: 0x4000800d678
0MQ LOCK: 0x40008001ca0
0MQ LOCK: 0x10061318
0MQ LOCK: 0x10041148
0MQ LOCK: 0x100321d0
0MQ LOCK: 0x10041148
0MQ LOCK: 0x40008001ca0
0MQ LOCK: 0x4000800d678
0MQ LOCK: 0x10058b08
0MQ MUTEX INIT: 0x40008019d98
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ MUTEX INIT: 0x40008019fb8
0MQ LOCK: 0x400080020d8
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008001ca0
0MQ MUTEX INIT: 0x4000801d1b8
0MQ LOCK: 0x40008001fe8
0MQ LOCK: 0x10049048
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x10049048
0MQ LOCK: 0x40008001fe8
0MQ LOCK: 0x4000801d1b8
0MQ LOCK: 0x10049048
0MQ LOCK: 0x400080020d8
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008019fb8
0MQ LOCK: 0x40008019d98
0MQ MUTEX INIT: 0x40008029be8
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x40008000f78
0MQ MUTEX INIT: 0x40008029dd8
0MQ LOCK: 0x40008002498
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008002498
0MQ LOCK: 0x40008000f78
0MQ LOCK: 0x10058b08
0MQ MUTEX INIT: 0x4000802cff8
0MQ LOCK: 0x400080023a8
0MQ LOCK: 0x10049048
0MQ LOCK: 0x10049048
0MQ LOCK: 0x400080023a8
0MQ LOCK: 0x4000802cff8
0MQ LOCK: 0x10049048
0MQ LOCK: 0x40008029dd8
0MQ LOCK: 0x40008029be8
0MQ MUTEX INIT: 0x400080305a8
0MQ MUTEX INIT: 0x40008030680
0MQ MUTEX INIT: 0x400080306f8
0MQ MUTEX INIT: 0x40008030770
0MQ MUTEX INIT: 0x400080307e8
0MQ MUTEX INIT: 0x40008030860
0MQ MUTEX INIT: 0x400080308d8
0MQ MUTEX INIT: 0x40008030950
0MQ MUTEX INIT: 0x400080309c8
0MQ MUTEX INIT: 0x40008030a40
0MQ MUTEX INIT: 0x40008030ab8
0MQ MUTEX INIT: 0x40008030b30
0MQ MUTEX INIT: 0x40008030ba8
0MQ MUTEX INIT: 0x40008030c20
0MQ MUTEX INIT: 0x40008030c98
0MQ MUTEX INIT: 0x40008030d10
0MQ MUTEX INIT: 0x40008030d88
0MQ MUTEX INIT: 0x40008030e00
0MQ MUTEX INIT: 0x40008030e78
0MQ MUTEX INIT: 0x40008030ef0
0MQ MUTEX INIT: 0x40008030f68
0MQ MUTEX INIT: 0x40008030fe0
0MQ MUTEX INIT: 0x40008031058
0MQ MUTEX INIT: 0x400080310d0
0MQ MUTEX INIT: 0x40008031148
0MQ MUTEX INIT: 0x400080311c0
0MQ MUTEX INIT: 0x40008030458
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080306f8
0MQ MUTEX INIT: 0x100686d8
0MQ MUTEX INIT: 0x40008039858
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x10040228
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10040228
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080307e8
0MQ LOCK: 0x400080307e8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x400080305a8
0MQ LOCK: 0x40008030860
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030860
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x10030c40
0MQ LOCK: 0x10030c40
0MQ MUTEX INIT: 0x10073fa8
0MQ MUTEX INIT: 0x10073ea8
0MQ LOCK: 0x40008030fe0
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10030c40
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10030cb8
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030fe0
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10073ea8
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10030c40
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10030cb8
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10073fa8
0MQ LOCK: 0x10040228
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10030e20
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10040228
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10030e20
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x100319d8
0MQ MUTEX INIT: 0x40008041048
0MQ LOCK: 0x100319d8
0MQ LOCK: 0x10030aa8
0MQ LOCK: 0x40008030b30
0MQ LOCK: 0x40008030458
0MQ MUTEX INIT: 0x1007f628
0MQ LOCK: 0x100319d8
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10041328
0MQ LOCK: 0x100319d8
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030b30
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10032860
0MQ MUTEX INIT: 0x1008acb8
0MQ LOCK: 0x10032860
0MQ MUTEX INIT: 0x400080441d8
0MQ LOCK: 0x40008030d88
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10032860
0MQ LOCK: 0x10032860
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10045018
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030d88
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10073fa8
0MQ LOCK: 0x10030c40
0MQ LOCK: 0x1008acb8
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030c40
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10073fa8
0MQ LOCK: 0x10073fa8
0MQ LOCK: 0x400080441d8
0MQ LOCK: 0x10073ea8
0MQ LOCK: 0x40008030fe0
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030fe0
0MQ LOCK: 0x10073ea8
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x400080306f8
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x40008039858
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x10040228
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10030f88
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x10040228
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10031d98
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10030cb8
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10041148
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10041148
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10030cb8
0MQ LOCK: 0x10031d98
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10061318
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10030e20
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x100686d8
0MQ LOCK: 0x10040228
0MQ LOCK: 0x10041328
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10041328
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10030e20
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10061318
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10061318
0MQ LOCK: 0x100459b8
0MQ LOCK: 0x10045018
0MQ LOCK: 0x10031d98
0MQ LOCK: 0x10041148
0MQ LOCK: 0x4000800d678
0MQ LOCK: 0x40008001958
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10031d98
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10061318
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008001958
0MQ LOCK: 0x4000800d678
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008019fb8
0MQ LOCK: 0x40008001d90
0MQ LOCK: 0x40008019d98
0MQ LOCK: 0x40008029dd8
0MQ LOCK: 0x40008001e08
0MQ LOCK: 0x40008029be8
0MQ LOCK: 0x1007f628
0MQ LOCK: 0x10061318
0MQ LOCK: 0x40008019d98
0MQ LOCK: 0x10061318
0MQ LOCK: 0x4000800d678
0MQ LOCK: 0x10061318
0MQ LOCK: 0x10041148
0MQ LOCK: 0x10061318
0MQ LOCK: 0x40008030458
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x4000800d678
0MQ LOCK: 0x40008001958
0MQ LOCK: 0x10058b08
0MQ LOCK: 0x40008041048
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x10031a50
0MQ LOCK: 0x40008030770
0MQ LOCK: 0x40008029be8
0MQ LOCK: 0x40008001e08
0MQ LOCK: 0x40008029dd8
0MQ LOCK: 0x400080477d0
0MQ BROKEN LOCK: 0x400080477d0
0MQ LOCK: 0x10031a50
Invalid argument (./zmq/mutex.hpp:101)
0MQ LOCK: 0x40008001d90
0MQ LOCK: 0x40008001d90
0MQ LOCK: 0x40008019fb8
0MQ LOCK: 0x400080477d0
0MQ BROKEN LOCK: 0x400080477d0
Aborted

More information about the zeromq-dev mailing list