[asterisk-bugs] [Asterisk 0014625]: Random deadlocks leading to lockup on 1.4.23.1

[Asterisk Bug Tracker]

A NOTE has been added to this issue. 
====================================================================== 
http://bugs.digium.com/view.php?id=14625 
====================================================================== 
Reported By:                acunningham
Assigned To:                tilghman
====================================================================== 
Project:                    Asterisk
Issue ID:                   14625
Category:                   General
Reproducibility:            random
Severity:                   major
Priority:                   normal
Status:                     acknowledged
Asterisk Version:           1.4.23 
Regression:                 No 
SVN Branch (only for SVN checkouts, not tarball releases): N/A 
SVN Revision (number only!):  
Request Review:              
====================================================================== 
Date Submitted:             2009-03-08 19:36 CDT
Last Modified:              2009-03-31 00:51 CDT
====================================================================== 
Summary:                    Random deadlocks leading to lockup on 1.4.23.1
Description: 
Random channels seem to be giving deadlocks on a 1.4.23.1 system:

# tail -f /var/log/asterisk/full | grep -i deadlock
[Mar  8 20:35:37] DEBUG[4249] channel.c: Avoiding initial deadlock for
channel '0x8779688'
[Mar  8 20:35:37] DEBUG[4249] channel.c: Avoiding initial deadlock for
channel '0x87ff698'
[Mar  8 20:35:42] DEBUG[4249] channel.c: Avoiding initial deadlock for
channel '0x8314468'
[Mar  8 20:35:46] DEBUG[4249] channel.c: Avoiding initial deadlock for
channel '0x861ddd0'


I've also seen "Avoiding deadlock" as well as "Avoiding initial deadlock",
though these are less common. The system is continually busy at medium load
(tens of calls). Over a period of days, the problem gets worse and worse
until Asterisk stops handling calls and needs to be killed with "kill -9".
Compiling with DEBUG_THREADS and running "core show locks" always shows:

=======================================================================
=== Currently Held Locks ==============================================
=======================================================================
===
=== <file> <line num> <function> <lock name> <lock addr> (times locked)
===
=======================================================================

with no further output. I've tried the patch in ticket
http://bugs.digium.com/view.php?id=13116 but this
doesn't help.

I'm not sure what debugs would be useful, but if someone can advise what
would be useful I'm happy to take them.
====================================================================== 

---------------------------------------------------------------------- 
 (0102445) acunningham (reporter) - 2009-03-31 00:51
 http://bugs.digium.com/view.php?id=14625#c102445 
---------------------------------------------------------------------- 
I'm not sure if it's the same problem, but Asterisk has just segfaulted
with:

Program terminated with signal 11, Segmentation fault.
http://bugs.digium.com/view.php?id=0  0x0809a294 in cli_next (i=0x43eb2980) at
cli.c:1549
1549                            i->helpers = AST_LIST_NEXT(e, list);
(gdb) bt
http://bugs.digium.com/view.php?id=0  0x0809a294 in cli_next (i=0x43eb2980) at
cli.c:1549
http://bugs.digium.com/view.php?id=1  0x0809a3a9 in find_cli (cmds=0x43eb29c0,
match_type=0) at cli.c:1569
http://bugs.digium.com/view.php?id=2  0x0809b622 in ast_cli_command (fd=1024,
s=0x43eb2d29 "show channel
SIP/5060-08350eb0") at cli.c:1987
http://bugs.digium.com/view.php?id=3  0x080ca589 in action_command (s=0x8522430,
m=0x43eb31a4) at
manager.c:1762
http://bugs.digium.com/view.php?id=4  0x080cc5ba in process_message
(s=0x8522430, m=0x43eb31a4) at
manager.c:2225
http://bugs.digium.com/view.php?id=5  0x080ccbaa in do_message (s=0x8522430) at
manager.c:2321
http://bugs.digium.com/view.php?id=6  0x080cccb7 in session_do (data=0x8522430)
at manager.c:2337
http://bugs.digium.com/view.php?id=7  0x0811bf45 in dummy_start (data=0x85f5c68)
at utils.c:856
http://bugs.digium.com/view.php?id=8  0x40028240 in start_thread () from
/lib/tls/i686/cmov/libpthread.so.0
http://bugs.digium.com/view.php?id=9  0x4017a49e in clone () from
/lib/tls/i686/cmov/libc.so.6 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2009-03-31 00:51 acunningham    Note Added: 0102445                          
======================================================================