[asterisk-bugs] [Asterisk 0015686]: [patch] app_queue crashes randomly, it seems to be during call-transfers

[Asterisk Bug Tracker]

A NOTE has been added to this issue. 
====================================================================== 
https://issues.asterisk.org/view.php?id=15686 
====================================================================== 
Reported By:                Hatrix
Assigned To:                dvossel
====================================================================== 
Project:                    Asterisk
Issue ID:                   15686
Category:                   Applications/app_queue
Reproducibility:            random
Severity:                   crash
Priority:                   normal
Status:                     feedback
Target Version:             1.4.28
Asterisk Version:           SVN 
JIRA:                       SWP-261 
Regression:                 No 
Reviewboard Link:            
SVN Branch (only for SVN checkouts, not tarball releases): N/A 
SVN Revision (number only!):  
Request Review:              
====================================================================== 
Date Submitted:             2009-08-10 02:16 CDT
Last Modified:              2009-11-25 09:56 CST
====================================================================== 
Summary:                    [patch] app_queue crashes randomly, it seems to be
during call-transfers
Description: 
We have had lot's of crashes in app_queue in our system. As the system was
never really stable it received software upgrades as well as totally new
(IBM) Hardware.

The crashes to app_queue are once or twice a week, sometimes more often,
mostly we have NO indication in the asterisk Log-Files. Ultimately (and
this may be because of a debug recompile) we get lines in the error log
like these:

[Aug  7 19:07:23] ERROR[27115]
/usr/local/src/asterisk-1.4.26/include/asterisk/lock.h: app_queue.c line
2559 (update_queue): Error obtaining mutex: Invalid argument

Funny thing is the system crashed on August the 6th (I do not have a
coredump) and on August the 7th at nearly the same time:

Aug  7 19:07:23 logitravel-voip2 kernel: [7905412.479435] asterisk[27115]:
segfault at d5d69fd0 ip b798757e sp b5258ef0 error 5 in
app_queue.so[b7984000+1c000]
Aug  6 19:00:57 logitravel-voip2 kernel: [7720142.069484] asterisk[7274]:
segfault at bb0f1be8 ip b796e57e sp b55f8ef0 error 4 in
app_queue.so[b796b000+1c000]


I have attached a backtrace, with bt, bt full and threads applied. I hope
it's any help because our client (a medium sized call-center) is waiting
for a solution.

We consider right now downgrading to debian stable (1.4.21.2) 

====================================================================== 

---------------------------------------------------------------------- 
 (0114276) aragon (reporter) - 2009-11-25 09:56
 https://issues.asterisk.org/view.php?id=15686#c114276 
---------------------------------------------------------------------- 
dvossel:
There were no crashes prior to testing your patch.
There are no crashes as a result of using your patch.
However the number of these warnings has hugely increased since installing
the patch.  I think this makes sense since the patch appears to address
some issues with hangups and the warnings only appear during hangups.
18 hours of testing my /var/log/asterisk/messages file went from 0 bytes
to 24MB and 99.9% contains only these types of warnings:
[Nov 25 00:17:17] WARNING[31107] channel.c: Exceptionally long voice queue
length queuing to Local/1637 at default-agent-0ce0,1
[Nov 25 00:17:17] WARNING[31402] channel.c: Exceptionally long voice queue
length queuing to Local/1614 at default-agent-0002,1
[Nov 25 00:17:17] WARNING[31436] channel.c: Exceptionally long voice queue
length queuing to Local/1638 at default-agent-35b1,1
[Nov 25 00:17:17] WARNING[31107] channel.c: Exceptionally long voice queue
length queuing to Local/1637 at default-agent-0ce0,1
[Nov 25 00:17:17] WARNING[31402] channel.c: Exceptionally long voice queue
length queuing to Local/1614 at default-agent-0002,1

Therefore to be bearer of bad news there seems to be some relation of this
issue to bug https://issues.asterisk.org/view.php?id=15609 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2009-11-25 09:56 aragon         Note Added: 0114276                          
======================================================================