[asterisk-bugs] [JIRA] (ASTERISK-26663) Chan_sip deadlock with local channel and audiohooks

Ruddy G (JIRA) noreply at issues.asterisk.org
Thu Dec 15 14:26:10 CST 2016


    [ https://issues.asterisk.org/jira/browse/ASTERISK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=234260#comment-234260 ] 

Ruddy G commented on ASTERISK-26663:
------------------------------------

Here is the backtrace on 11.25.1. Hope this will help.




(gdb)
(gdb) thread apply all bt

Thread 52 (Thread 0xb70beb40 (LWP 21146)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa085c88, mutex=0xa085cbc) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xa085c88, t=t at entry=0xa085cbc) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xa085c84) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xa085d18) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb70beb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 51 (Thread 0xb7082b40 (LWP 21147)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x080882c2 in poll (__timeout=-1, __nfds=1, __fds=0xb7082260) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  listener (unused=unused at entry=0x0) at asterisk.c:1450
#4  0x081e382a in dummy_start (data=0xa089110) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb7082b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 50 (Thread 0xb7046b40 (LWP 21148)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0x827b4e0 <logcond>, mutex=0x8263428 <logmsgs+8>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8214c44 "logger.c", lineno=<optimized out>, lineno at entry=1216,
    func=func at entry=0x8215a60 <__PRETTY_FUNCTION__.14952> "logger_thread", cond_name=cond_name at entry=0x8214cae "&logcond",
    mutex_name=mutex_name at entry=0x8214dc0 "&logmsgs.lock", cond=cond at entry=0x827b4e0 <logcond>, t=t at entry=0x8263428 <logmsgs+8>) at lock.c:600
#4  0x0814d49e in logger_thread (data=data at entry=0x0) at logger.c:1216
#5  0x081e382a in dummy_start (data=0xa089218) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb7046b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 49 (Thread 0xb6effb40 (LWP 21149)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0x827a800 <dbcond>, mutex=0x8260ce0 <dblock>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8206ee5 "db.c", lineno=<optimized out>, lineno at entry=967,
    func=func at entry=0x8207b99 <__PRETTY_FUNCTION__.15237> "db_sync_thread", cond_name=cond_name at entry=0x8206fab "&dbcond",
    mutex_name=mutex_name at entry=0x8206edd "&dblock", cond=cond at entry=0x827a800 <dbcond>, t=t at entry=0x8260ce0 <dblock>) at lock.c:600
#4  0x080fa0cf in db_sync_thread (data=data at entry=0x0) at db.c:967
#5  0x081e382a in dummy_start (data=0xa13e9c0) at utils.c:1223
---Type <return> to continue, or q <return> to quit---
#6  0xb71bdf70 in start_thread (arg=0xb6effb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 48 (Thread 0xb6ec3b40 (LWP 21150)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa3b35a0, mutex=0xa3b35d4) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xa3b35a0, t=t at entry=0xa3b35d4) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xa3b359c) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xa0b0fb0) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6ec3b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 47 (Thread 0xb6e87b40 (LWP 21151)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x081e5473 in poll (__timeout=-1, __nfds=1, __fds=0xb6e87208) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_wait_for_input (fd=8, ms=-1) at utils.c:1312
#4  0x081d5cc1 in ast_tcptls_server_root (data=data at entry=0x8262b20 <http_desc>) at tcptls.c:714
#5  0x081e382a in dummy_start (data=0xa13c938) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6e87b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 46 (Thread 0xb6e4bb40 (LWP 21152)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0x827a860 <change_pending>, mutex=0x8260d88 <state_changes+8>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8207f10 "devicestate.c", lineno=<optimized out>, lineno at entry=559,
    func=func at entry=0x82084c4 <__PRETTY_FUNCTION__.14514> "do_devstate_changes", cond_name=cond_name at entry=0x8207f36 "&change_pending",
    mutex_name=mutex_name at entry=0x8207fcf "&state_changes.lock", cond=cond at entry=0x827a860 <change_pending>, t=t at entry=0x8260d88 <state_changes+8>) at lock.c:600
#4  0x080fd7fa in do_devstate_changes (data=data at entry=0x0) at devicestate.c:559
#5  0x081e382a in dummy_start (data=0xa13fbb8) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6e4bb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 45 (Thread 0xb6cffb40 (LWP 21153)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0x827b8c0 <change_pending>, mutex=0x8265268 <state_changes+8>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8221e88 "presencestate.c", lineno=<optimized out>, lineno at entry=299,
    func=func at entry=0x8221f60 <__PRETTY_FUNCTION__.14454> "do_presence_changes", cond_name=cond_name at entry=0x8207f36 "&change_pending",
---Type <return> to continue, or q <return> to quit---
    mutex_name=mutex_name at entry=0x8207fcf "&state_changes.lock", cond=cond at entry=0x827b8c0 <change_pending>, t=t at entry=0x8265268 <state_changes+8>) at lock.c:600
#4  0x0819c0dc in do_presence_changes (data=data at entry=0x0) at presencestate.c:299
#5  0x081e382a in dummy_start (data=0xa3c6b38) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6cffb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 44 (Thread 0xb6cc3b40 (LWP 21154)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa3ce0c0, mutex=0xa3ce0f4) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xa3ce0c0, t=t at entry=0xa3ce0f4) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xa3ce0bc) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xa3ce150) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6cc3b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 43 (Thread 0xb6c87b40 (LWP 21155)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08119008 in poll (__timeout=<optimized out>, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  do_parking_thread (ignore=ignore at entry=0x0) at features.c:5332
#4  0x081e382a in dummy_start (data=0xa3ce150) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb6c87b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 42 (Thread 0xb6c4bb40 (LWP 21156)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa3e1378, mutex=0xa3e13ac) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xa3e1378, t=t at entry=0xa3e13ac) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xa3e1374) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xa3d2338) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6c4bb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 41 (Thread 0xb6c0fb40 (LWP 21157)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa3e01fc, mutex=0xa3e13e8) at forward.c:149
---Type <return> to continue, or q <return> to quit---
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8225f01 "sched.c", lineno=<optimized out>, lineno at entry=141,
    func=func at entry=0x82260a6 <__PRETTY_FUNCTION__.12452> "sched_run", cond_name=cond_name at entry=0x8225f09 "&con->sched_thread->cond",
    mutex_name=mutex_name at entry=0x821f3b9 "&con->lock", cond=0xa3e01fc, t=t at entry=0xa3e13e8) at lock.c:600
#4  0x081c87f7 in sched_run (data=data at entry=0xa3e13e8) at sched.c:141
#5  0x081e382a in dummy_start (data=0xa3e0238) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb6c0fb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 40 (Thread 0xb5587b40 (LWP 21158)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xb680f1a4 <timing_thread+36>, mutex=0xb680f184 <timing_thread+4>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, lineno at entry=476, func=0xb680d28a <__PRETTY_FUNCTION__.10422> "do_timing",
    cond_name=0xb680cf38 "&timing_thread.cond", mutex_name=0xb680cf24 "&timing_thread.lock", cond=0xb680f1a4 <timing_thread+36>, t=0xb680f184 <timing_thread+4>)
    at lock.c:600
#4  0xb680c23f in do_timing (arg=arg at entry=0x0) at res_timing_pthread.c:476
#5  0x081e382a in dummy_start (data=0xa09a180) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb5587b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 39 (Thread 0xb554bb40 (LWP 21159)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76ab826 in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#2  0xb76da88d in usleep (useconds=10000) at ../sysdeps/unix/sysv/linux/usleep.c:32
#3  0xb5b72bf4 in pj_thread_sleep () from /usr/lib/asterisk/modules/res_rtp_asterisk.so
#4  0xb5b71b6b in pj_ioqueue_poll () from /usr/lib/asterisk/modules/res_rtp_asterisk.so


#5  0xb5b3f746 in timer_worker_thread (data=0x0) at res_rtp_asterisk.c:1800
#6  0xb5b72765 in thread_main () from /usr/lib/asterisk/modules/res_rtp_asterisk.so
#7  0xb71bdf70 in start_thread (arg=0xb554bb40) at pthread_create.c:312
#8  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 38 (Thread 0xb4d28b40 (LWP 21160)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76e30d8 in accept () at ../sysdeps/unix/sysv/linux/i386/socket.S:95

#2  0xb5b9dc6e in accept_thread (ignore=ignore at entry=0x0) at chan_skinny.c:7007
#3  0x081e382a in dummy_start (data=0xa454448) at utils.c:1223
#4  0xb71bdf70 in start_thread (arg=0xb4d28b40) at pthread_create.c:312
#5  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 37 (Thread 0xb4cecb40 (LWP 21161)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa454924, mutex=0xa454750) at forward.c:149
---Type <return> to continue, or q <return> to quit---
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8225f01 "sched.c", lineno=<optimized out>, lineno at entry=141,
    func=func at entry=0x82260a6 <__PRETTY_FUNCTION__.12452> "sched_run", cond_name=cond_name at entry=0x8225f09 "&con->sched_thread->cond",
    mutex_name=mutex_name at entry=0x821f3b9 "&con->lock", cond=0xa454924, t=t at entry=0xa454750) at lock.c:600
#4  0x081c87f7 in sched_run (data=data at entry=0xa454750) at sched.c:141
#5  0x081e382a in dummy_start (data=0xa454960) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4cecb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 36 (Thread 0xb4cb0b40 (LWP 21162)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x081e5473 in poll (__timeout=-1, __nfds=1, __fds=0xb4cb0208) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_wait_for_input (fd=13, ms=-1) at utils.c:1312
#4  0x081d5cc1 in ast_tcptls_server_root (data=data at entry=0xb5a52a00 <sip_tcp_desc>) at tcptls.c:714
#5  0x081e382a in dummy_start (data=0xa47ba48) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4cb0b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 35 (Thread 0xb4c74b40 (LWP 21163)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c49e2 in __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/lowlevellock.S:144
#2  0xb71c0275 in _L_lock_928 () from /lib/i386-linux-gnu/libpthread.so.0
#3  0xb71c00f8 in __GI___pthread_mutex_lock (mutex=0xb6f0c0a0) at ../nptl/pthread_mutex_lock.c:114




#4  0xb76eefd4 in pthread_mutex_lock (mutex=0xb6f0c0a0) at forward.c:192
#5  0x0814bb8b in __ast_pthread_mutex_lock (filename=<optimized out>, lineno=8995, func=0xb5a441f7 <__PRETTY_FUNCTION__.33377> "sip_pvt_lock_full",
    mutex_name=0xb5a2b195 "chan", t=0xb6f0c0a0) at lock.c:315
#6  0x0808be01 in __ao2_lock (user_data=<optimized out>, user_data at entry=0xb6f0c0d4, lock_how=<optimized out>, lock_how at entry=AO2_LOCK_REQ_MUTEX,
    file=<optimized out>, file at entry=0xb5a2b060 "chan_sip.c", func=<optimized out>, func at entry=0xb5a441f7 <__PRETTY_FUNCTION__.33377> "sip_pvt_lock_full",
    line=<optimized out>, line at entry=8995, var=var at entry=0xb5a2b195 "chan") at astobj2.c:198
#7  0xb598176f in sip_pvt_lock_full (pvt=pvt at entry=0xabc473c) at chan_sip.c:8995
#8  0xb5a21681 in handle_request_do (req=req at entry=0xb4c73c20, addr=addr at entry=0xb4c74168) at chan_sip.c:28820

#9  0xb5a2334e in sipsock_read (id=0xb6d00578, fd=12, events=1, ignore=ignore at entry=0x0) at chan_sip.c:28765
#10 0x08146f7a in ast_io_wait (ioc=0xa46c508, howlong=1000) at io.c:292
#11 0xb59f951a in do_monitor (data=data at entry=0x0) at chan_sip.c:29364
#12 0x081e382a in dummy_start (data=0xa47cf88) at utils.c:1223
#13 0xb71bdf70 in start_thread (arg=0xb4c74b40) at pthread_create.c:312
#14 0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 34 (Thread 0xb4bb6b40 (LWP 21164)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa8196f8, mutex=0xa81972c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
---Type <return> to continue, or q <return> to quit---
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xa8196f8, t=t at entry=0xa81972c) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xa8196f4) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xa819790) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4bb6b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 33 (Thread 0xb4b7ab40 (LWP 21165)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa819e0c, mutex=0xa8198b8) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8225f01 "sched.c", lineno=<optimized out>, lineno at entry=141,
    func=func at entry=0x82260a6 <__PRETTY_FUNCTION__.12452> "sched_run", cond_name=cond_name at entry=0x8225f09 "&con->sched_thread->cond",
    mutex_name=mutex_name at entry=0x821f3b9 "&con->lock", cond=0xa819e0c, t=t at entry=0xa8198b8) at lock.c:600
#4  0x081c87f7 in sched_run (data=data at entry=0xa8198b8) at sched.c:141
#5  0x081e382a in dummy_start (data=0xa819e48) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4b7ab40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 32 (Thread 0xb4b3eb40 (LWP 21166)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa84208c, mutex=0xa84206c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa84208c, t=0xa84206c) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa840fd8) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa81da40) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4b3eb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 31 (Thread 0xb4b02b40 (LWP 21167)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa8431ec, mutex=0xa8431cc) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa8431ec, t=0xa8431cc) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa842138) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa81da40) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4b02b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

---Type <return> to continue, or q <return> to quit---
Thread 30 (Thread 0xb4ac6b40 (LWP 21168)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa84434c, mutex=0xa84432c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa84434c, t=0xa84432c) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa843298) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819e48) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4ac6b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 29 (Thread 0xb4a8ab40 (LWP 21169)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa84555c, mutex=0xa84553c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa84555c, t=0xa84553c) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa8444a8) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819790) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4a8ab40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 28 (Thread 0xb4a4eb40 (LWP 21170)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa8467d4, mutex=0xa8467b4) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa8467d4, t=0xa8467b4) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa845720) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa81da40) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4a4eb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 27 (Thread 0xb4a12b40 (LWP 21171)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa847a4c, mutex=0xa847a2c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa847a4c, t=0xa847a2c) at lock.c:600
---Type <return> to continue, or q <return> to quit---
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa846998) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819e48) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4a12b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 26 (Thread 0xb49d6b40 (LWP 21172)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa848cc4, mutex=0xa848ca4) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa848cc4, t=0xa848ca4) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa847c10) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819790) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb49d6b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 25 (Thread 0xb499ab40 (LWP 21173)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa849f3c, mutex=0xa849f1c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa849f3c, t=0xa849f1c) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa848e88) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa81da40) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb499ab40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 24 (Thread 0xb495eb40 (LWP 21174)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa84b1b4, mutex=0xa84b194) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa84b1b4, t=0xa84b194) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa84a100) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819e48) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb495eb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 23 (Thread 0xb4922b40 (LWP 21175)):
#0  0xb77b8428 in __kernel_vsyscall ()
---Type <return> to continue, or q <return> to quit---
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xa84c42c, mutex=0xa84c40c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0xb57eec1f "chan_iax2.c", lineno=<optimized out>, lineno at entry=12112,
    func=func at entry=0xb57f16d0 <__PRETTY_FUNCTION__.21596> "iax2_process_thread", cond_name=cond_name at entry=0xb57eef66 "&thread->cond",
    mutex_name=0xb57eef74 "&thread->lock", cond=0xa84c42c, t=0xa84c40c) at lock.c:600
#4  0xb57e2c92 in iax2_process_thread (data=data at entry=0xa84b378) at chan_iax2.c:12112
#5  0x081e382a in dummy_start (data=0xa819790) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb4922b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 22 (Thread 0xb48e6b40 (LWP 21176)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08146f1b in poll (__timeout=__timeout at entry=1000, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_io_wait (ioc=0xa819f70, howlong=howlong at entry=1000) at io.c:279
#4  0xb57b1b79 in network_thread (ignore=ignore at entry=0x0) at chan_iax2.c:12616
#5  0x081e382a in dummy_start (data=0xa819790) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb48e6b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 21 (Thread 0xb48aab40 (LWP 21177)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08146f1b in poll (__timeout=1000, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_io_wait (ioc=0xa81d580, howlong=1000) at io.c:279
#4  0xb5773738 in do_monitor (data=data at entry=0x0) at chan_mgcp.c:3894
#5  0x081e382a in dummy_start (data=0xa81d4c8) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb48aab40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 20 (Thread 0xb486eb40 (LWP 21178)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0xb6620fc9 in poll (__timeout=1000, __nfds=0, __fds=0xb6f00d88) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  do_monitor (data=data at entry=0x0) at chan_dahdi.c:12086
#4  0x081e382a in dummy_start (data=0xa850a60) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb486eb40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 19 (Thread 0xb4832b40 (LWP 21179)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0xb56e709b in poll (__timeout=<optimized out>, __nfds=1, __fds=0xb48302d4) at /usr/include/i386-linux-gnu/bits/poll2.h:46
---Type <return> to continue, or q <return> to quit---
#3  scan_thread (unused=unused at entry=0x0) at pbx_spool.c:730
#4  0x081e382a in dummy_start (data=0xa852768) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb4832b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 18 (Thread 0xb47f6b40 (LWP 21180)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76ab826 in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#2  0xb643e843 in cleanup (unused=unused at entry=0x0) at pbx_realtime.c:133
#3  0x081e382a in dummy_start (data=0xa85fbb8) at utils.c:1223
#4  0xb71bdf70 in start_thread (arg=0xb47f6b40) at pthread_create.c:312
#5  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 17 (Thread 0xb47bab40 (LWP 21181)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08146f1b in poll (__timeout=__timeout at entry=1000, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_io_wait (ioc=0xaaf59f8, howlong=howlong at entry=1000) at io.c:279
#4  0xb5acd179 in do_monitor (data=data at entry=0x0) at chan_unistim.c:5737
#5  0x081e382a in dummy_start (data=0xaaf6960) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb47bab40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 16 (Thread 0xb477eb40 (LWP 21182)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0xb55a46ae in poll (__timeout=-1, __nfds=0, __fds=0x0) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  do_monitor (data=data at entry=0x0) at chan_phone.c:1085
#4  0x081e382a in dummy_start (data=0xab273b0) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb477eb40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 15 (Thread 0xb4742b40 (LWP 21183)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76ab826 in nanosleep () at ../sysdeps/unix/syscall-template.S:81

#2  0xb6836418 in lock_broker (unused=unused at entry=0x0) at func_lock.c:211
#3  0x081e382a in dummy_start (data=0xab273f0) at utils.c:1223
#4  0xb71bdf70 in start_thread (arg=0xb4742b40) at pthread_create.c:312
#5  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 13 (Thread 0xb46cab40 (LWP 21185)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0xb6a6b20b in g_poll () from /lib/i386-linux-gnu/libglib-2.0.so.0
#3  0xb6a5c3e8 in ?? () from /lib/i386-linux-gnu/libglib-2.0.so.0
#4  0xb6a5c76b in g_main_loop_run () from /lib/i386-linux-gnu/libglib-2.0.so.0
#5  0xb6b517f1 in xmpp::Connection::run (this=0xab4ac40) at src/Connection.cpp:223
#6  0xb6b5dd87 in threading::ThreadManager::threadWorker (data=0xab4ad08) at src/ThreadManager.cpp:25
#7  0xb71bdf70 in start_thread (arg=0xb46cab40) at pthread_create.c:312
#8  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 12 (Thread 0xb468eb40 (LWP 21186)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08146f1b in poll (__timeout=1000, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  ast_io_wait (ioc=0xab4e330, howlong=1000) at io.c:279
#4  0xb64852c7 in network_thread (ignore=ignore at entry=0x0) at pbx_dundi.c:2182
#5  0x081e382a in dummy_start (data=0xab513d8) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb468eb40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 11 (Thread 0xb4652b40 (LWP 21187)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76ab826 in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#2  0xb76ab5cd in __sleep (seconds=0, seconds at entry=1) at ../sysdeps/unix/sysv/linux/sleep.c:137
#3  0xb6495550 in process_precache (ign=ign at entry=0x0) at pbx_dundi.c:2260
#4  0x081e382a in dummy_start (data=0xab4def0) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb4652b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 10 (Thread 0xb4616b40 (LWP 21188)):
#0  0xb77b8428 in __kernel_vsyscall ()
---Type <return> to continue, or q <return> to quit---
#1  0xb76ab826 in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#2  0xb76ab5cd in __sleep (seconds=0, seconds at entry=60) at ../sysdeps/unix/sysv/linux/sleep.c:137
#3  0xb648104b in process_clearcache (ignore=ignore at entry=0x0) at pbx_dundi.c:2223
#4  0x081e382a in dummy_start (data=0xab4e3d8) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb4616b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 9 (Thread 0xb3dd9b40 (LWP 21190)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xab51950, mutex=0xab51984) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xab51950, t=t at entry=0xab51984) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xab5194c) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xab5c3e0) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb3dd9b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 8 (Thread 0xb3d9db40 (LWP 21194)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0xab964e8, mutex=0xab9651c) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x8227b9c "taskprocessor.c", lineno=<optimized out>, lineno at entry=314,
    func=func at entry=0x82281f0 <__PRETTY_FUNCTION__.9094> "tps_processing_function", cond_name=cond_name at entry=0x8227c41 "&i->poll_cond",
    mutex_name=mutex_name at entry=0x8227c2a "&i->taskprocessor_lock", cond=cond at entry=0xab964e8, t=t at entry=0xab9651c) at lock.c:600
#4  0x081d346c in tps_processing_function (data=data at entry=0xab964e4) at taskprocessor.c:314
#5  0x081e382a in dummy_start (data=0xab77510) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb3d9db40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129


Thread 5 (Thread 0xb3c71b40 (LWP 21231)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x08087c21 in poll (__timeout=-1, __nfds=2, __fds=0xb3c70e80) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  netconsole (vconsole=vconsole at entry=0x8295500 <consoles>) at asterisk.c:1371
#4  0x081e382a in dummy_start (data=0xb6d0d118) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb3c71b40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 4 (Thread 0xb3bf9b40 (LWP 21622)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c1d4b in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:187
#2  0xb76eedcc in __pthread_cond_wait (cond=0x827a320 <as_cond>, mutex=0x825f5e8 <aslist+8>) at forward.c:149
#3  0x0814bbf6 in __ast_cond_wait (filename=<optimized out>, filename at entry=0x81f6b06 "autoservice.c", lineno=<optimized out>, lineno at entry=103,
    func=func at entry=0x81f6c12 <__PRETTY_FUNCTION__.13988> "autoservice_run", cond_name=cond_name at entry=0x81f6b21 "&as_cond",
    mutex_name=mutex_name at entry=0x81f6b14 "&aslist.lock", cond=cond at entry=0x827a320 <as_cond>, t=t at entry=0x825f5e8 <aslist+8>) at lock.c:600
#4  0x080974dd in autoservice_run (ign=ign at entry=0x0) at autoservice.c:103
#5  0x081e382a in dummy_start (data=0xa563408) at utils.c:1223
#6  0xb71bdf70 in start_thread (arg=0xb3bf9b40) at pthread_create.c:312
#7  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 3 (Thread 0xb3bbdb40 (LWP 21623)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d0c1b in read () at ../sysdeps/unix/syscall-template.S:81
#2  0x081cb62d in read (__nbytes=4113, __buf=0xb3bbc2c0, __fd=<optimized out>) at /usr/include/i386-linux-gnu/bits/unistd.h:44
#3  inotify_daemon (data=data at entry=0x0) at stdtime/localtime.c:380
#4  0x081e382a in dummy_start (data=0xa563408) at utils.c:1223
#5  0xb71bdf70 in start_thread (arg=0xb3bbdb40) at pthread_create.c:312
#6  0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 2 (Thread 0xb3ce9b40 (LWP 21789)):
---Type <return> to continue, or q <return> to quit---
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb71c49e2 in __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/lowlevellock.S:144
#2  0xb71c2677 in pthread_cond_signal@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_signal.S:210
#3  0xb76eed84 in __pthread_cond_signal (cond=0xb6d1290c) at forward.c:138
#4  0x0814bbc7 in __ast_cond_signal (filename=<optimized out>, filename at entry=0x81f65e1 "audiohook.c", lineno=lineno at entry=536,
    func=func at entry=0x81f6924 <__PRETTY_FUNCTION__.12624> "ast_audiohook_update_status", cond_name=cond_name at entry=0x81f65cd "&audiohook->trigger",
    cond=cond at entry=0xb6d1290c) at lock.c:510
#5  0x080951af in ast_audiohook_update_status (status=AST_AUDIOHOOK_STATUS_DONE, audiohook=0xb6d128ec) at audiohook.c:536

#6  ast_audiohook_detach_list (audiohook_list=0xb6d4d530) at audiohook.c:579

#7  0x080cc5ca in destroy_hooks (chan=0xb6f0c0d4) at channel.c:2745

#8  ast_hangup (chan=0xb6f0c0d4) at channel.c:2805
#9  0x08183cf4 in ast_pbx_run_app (data=0xb6f1d8c0) at pbx.c:10904
#10 0x08192a74 in ast_pbx_outgoing_app (type=0xb6f23c70 "Local", cap=0xb6f1d898, addr=0xb6f23c78 "5140000000 at foniva-inbound", timeout=45000, app=<optimized out>,
    appdata=<optimized out>, reason=reason at entry=0xb3ce92d0, synchronous=synchronous at entry=2, cid_num=0x8292142 <__ast_string_field_empty_buffer+2> "",
    cid_name=0x8292142 <__ast_string_field_empty_buffer+2> "", vars=0x0, account=0x8292142 <__ast_string_field_empty_buffer+2> "",
    locked_channel=locked_channel at entry=0x0) at pbx.c:10964
#11 0xb56e6778 in attempt_thread (data=data at entry=0xb6f00e68) at pbx_spool.c:401
#12 0x081e382a in dummy_start (data=0xb6f0ad98) at utils.c:1223
#13 0xb71bdf70 in start_thread (arg=0xb3ce9b40) at pthread_create.c:312
#14 0xb76e1bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129

Thread 1 (Thread 0xb70bf700 (LWP 21145)):
#0  0xb77b8428 in __kernel_vsyscall ()
#1  0xb76d2c8b in poll () at ../sysdeps/unix/syscall-template.S:81
#2  0x080871a8 in poll (__timeout=-1, __nfds=1, __fds=0xbf98bc60) at /usr/include/i386-linux-gnu/bits/poll2.h:46
#3  monitor_sig_flags (unused=unused at entry=0x0) at asterisk.c:3609
#4  0x08069edf in asterisk_daemon (isroot=<optimized out>, rungroup=<optimized out>, runuser=<optimized out>) at asterisk.c:4411
#5  main (argc=<optimized out>, argv=0xbf98de54) at asterisk.c:4120
(gdb)
(gdb)

> Chan_sip deadlock with local channel and audiohooks
> ---------------------------------------------------
>
>                 Key: ASTERISK-26663
>                 URL: https://issues.asterisk.org/jira/browse/ASTERISK-26663
>             Project: Asterisk
>          Issue Type: Bug
>      Security Level: None
>    Affects Versions: 11.14.0, 11.25.1
>            Reporter: Ruddy G
>
> Hi,
> I discovered what creates a deadlock in asterisk and prevent any new sip registration to occur.
> There are two scenarios. 
> Scenario 1: A local channel calls an application that installs audiohooks on it before calling a SIP user. At the end of the call, we have a deadlock.
> Scenario 2: A SIP user calls a PBX which dial a Local channel with an announcement. That local channel dials another SIP user. This last user answers the phone and transfers it before the announcement is completed.
> Scenario 1:
> Create a p.call file wih a local channel
> Channel: Local/51400000000 at my-inbound
> Application: SayAlpha
> Data: 123456789
> Inside [my-inbound] context, have the channel create an audiohook and then dial a SIP trunk.
> At the end of the call, the PBX SIP module is deadlocked.
> No new registration is allowed.
> Here are the relevant threads backtraces:
> Thread 34 (Thread 0xb54eab40 (LWP 31178)):
> #0  0xb77ce428 in __kernel_vsyscall ()
> #1  0xb71da9e2 in __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/lowlevellock.S:144
> #2  0xb71d6275 in _L_lock_928 () from /lib/i386-linux-gnu/libpthread.so.0
> #3  0xb71d60f8 in __GI___pthread_mutex_lock (mutex=0x98b2260) at ../nptl/pthread_mutex_lock.c:114
> #4  0xb7704fd4 in pthread_mutex_lock (mutex=0x98b2260) at forward.c:192
> #5  0x08135b5f in __ast_pthread_mutex_lock (filename=0xb5a93274 "chan_sip.c", lineno=8973, func=0xb5aabf8f <__PRETTY_FUNCTION__.31584> "sip_pvt_lock_full", mutex_name=0xb5a95208 "chan", t=0x98b2260) at lock.c:273
> #6  0x0808bdd6 in __ao2_lock (user_data=0x98b2294, lock_how=AO2_LOCK_REQ_MUTEX, file=0xb5a93274 "chan_sip.c", func=0xb5aabf8f <__PRETTY_FUNCTION__.31584> "sip_pvt_lock_full", line=8973, var=0xb5a95208 "chan") at astobj2.c:195
> #7  0xb5a04e69 in sip_pvt_lock_full (pvt=0xb6d0c834) at chan_sip.c:8973
> #8  0xb5a660cf in handle_request_do (req=0xb54e9c74, addr=0xb54ea1b8) at chan_sip.c:28521
> #9  0xb5a65d9c in sipsock_read (id=0xb6f00518, fd=11, events=1, ignore=0x0) at chan_sip.c:28466
> #10 0x08130910 in ast_io_wait (ioc=0x97a4738, howlong=1000) at io.c:292
> #11 0xb5a67cfe in do_monitor (data=0x0) at chan_sip.c:29064
> #12 0x081c5145 in dummy_start (data=0x97a6268) at utils.c:1192
> #13 0xb71d3f70 in start_thread (arg=0xb54eab40) at pthread_create.c:312
> #14 0xb76f7bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129
> Thread 2 (Thread 0xb473fb40 (LWP 1265)):
> #0  0xb77ce428 in __kernel_vsyscall ()
> #1  0xb71da9e2 in __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/lowlevellock.S:144
> #2  0xb71d8677 in pthread_cond_signal@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_signal.S:210
> #3  0xb7704d84 in __pthread_cond_signal (cond=0xb6d20324) at forward.c:138
> #4  0x08135bc4 in __ast_cond_signal (filename=0x81d5f34 "audiohook.c", lineno=491, func=0x81d61d2 <__PRETTY_FUNCTION__.11233> "ast_audiohook_update_status", cond_name=0x81d5f51 "&audiohook->trigger", cond=0xb6d20324) at lock.c:493
> #5  0x0808ffb1 in ast_audiohook_update_status (audiohook=0xb6d20304, status=AST_AUDIOHOOK_STATUS_DONE) at audiohook.c:491
> #6  0x08090135 in ast_audiohook_detach_list (audiohook_list=0xb6d2e640) at audiohook.c:534
> #7  0x080b4e61 in destroy_hooks (chan=0x98b2294) at channel.c:2744
> #8  0x080b5087 in ast_hangup (chan=0x98b2294) at channel.c:2804
> #9  0x08175e24 in ast_pbx_run_app (data=0x9800c08) at pbx.c:10585
> #10 0x081762fa in ast_pbx_outgoing_app (type=0xb4016418 "Local", cap=0xb6f23500, addr=0xb4016420 "5140000000 at my-inbound", timeout=45000, app=0xb401643c "SayAlpha", appdata=0xb4016448 "123456789", reason=0xb473f2c4, synchronous=2, cid_num=0x826f1a6 <__ast_string_field_empty_buffer+2> "", cid_name=0x826f1a6 <__ast_string_field_empty_buffer+2> "", vars=0x0, account=0x826f1a6 <__ast_string_field_empty_buffer+2> "", locked_channel=0x0) at pbx.c:10645
> #11 0xb57526ed in attempt_thread (data=0xb2866690) at pbx_spool.c:376
> #12 0x081c5145 in dummy_start (data=0xb6f372c8) at utils.c:1192
> #13 0xb71d3f70 in start_thread (arg=0xb473fb40) at pthread_create.c:312
> #14 0xb76f7bee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:129
> Scenario 2:
> Caller A calls from outside and reach context [my-inbound]
> Inside such context, we do dial a local context with announcement:
> Dial(Local/000 at my-local-context,A(myaudio))
> Inside the [my-local-context], simply call SIP user B
> [my-local-context]
> exten => 000,1,Dial(SIP/userb,30)
> So, user B answers the phone. Before his myaudio.gsm announcement is completed, he transfers the call to another location.
> Basically, B just transfer his own local channel instead of SIP/userA
> A deadlock occurs with the same backtraces.



--
This message was sent by Atlassian JIRA
(v6.2#6252)



More information about the asterisk-bugs mailing list