[asterisk-bugs] [Asterisk 0015997]: segfault in 1.6.1.6 in _ao2_find, called from chan_iax2 after approx. 75.000 calls

[Asterisk Bug Tracker]

A NOTE has been added to this issue. 
====================================================================== 
https://issues.asterisk.org/view.php?id=15997 
====================================================================== 
Reported By:                exarv
Assigned To:                russell
====================================================================== 
Project:                    Asterisk
Issue ID:                   15997
Category:                   Channels/chan_iax2
Reproducibility:            have not tried
Severity:                   crash
Priority:                   normal
Status:                     assigned
Asterisk Version:           1.6.1.6 
JIRA:                        
Regression:                 No 
Reviewboard Link:            
SVN Branch (only for SVN checkouts, not tarball releases): N/A 
SVN Revision (number only!):  
Request Review:              
====================================================================== 
Date Submitted:             2009-10-01 02:37 CDT
Last Modified:              2010-01-19 07:00 CST
====================================================================== 
Summary:                    segfault in 1.6.1.6 in _ao2_find, called from
chan_iax2 after approx. 75.000 calls
Description: 
I'm running Asterisk 1.6.1.6 since 19 days now,
but I've had 3 times a segfault on the same address.

Sep 17 13:03:57 switch02 kernel: asterisk[13597]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 00000000420b1440 error 4
     In the mean time 75.517 calls were setup.
Sep 22 19:07:13 switch02 kernel: asterisk[23982]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 0000000042142440 error 4
     In the mean time  76.725 calls were setup.
Sep 28 14:26:16 switch02 kernel: asterisk[2777]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 0000000042088440 error 4

It's a live server running production traffic. So I don't have much 
possibilities to easily test a different version.
Also the issue only happens to me once a week (about once every approx. 
75.000 calls).
The segfault didn't happen on the most busiest times (sunday), but just 
on the more quiet days.

The last time the server had 50 calls, 97 channels (43 chan_ss7 
channels, 46 sip channels and 8 iax2 channels)

Software running:
  - CentOS 5 (latest updates as of 11 sept 2009)
  - asterisk 1.6.1.6
  - chan_ss7 1.2.1
  - dahdi-linux 2.2.0.2
  - dahdi-tools 2.2.0
  - wanpipe 3.5.6



====================================================================== 

---------------------------------------------------------------------- 
 (0116882) jensvb (reporter) - 2010-01-19 07:00
 https://issues.asterisk.org/view.php?id=15997#c116882 
---------------------------------------------------------------------- 
Hi All,

Asterisk 1.4.28 crashed today with the same problem... Full backtrace
attached.

<snip>
Thread 1 (process 30394):

https://issues.asterisk.org/view.php?id=0  0x000000000042d579 in ao2_find
(c=0x1800076c2, arg=0x42182f00,
flags=OBJ_POINTER) at astobj2.c:571

https://issues.asterisk.org/view.php?id=1  0x00002aaac611587b in __find_callno
(callno=15348, dcallno=0,
sin=0x42185cd0, new=0, sockfd=18, return_locked=1, check_dcallno=0) at
chan_iax2.c:2391

https://issues.asterisk.org/view.php?id=2  0x00002aaac6116732 in
find_callno_locked (callno=15348, dcallno=0,
sin=0x42185cd0, new=0, sockfd=18, full_frame=0) at chan_iax2.c:2544

https://issues.asterisk.org/view.php?id=3  0x00002aaac6132525 in socket_process
(thread=0x2aaab85e73b0) at
chan_iax2.c:8427

https://issues.asterisk.org/view.php?id=4  0x00002aaac613e7dd in
iax2_process_thread (data=0x2aaab85e73b0) at
chan_iax2.c:10041

https://issues.asterisk.org/view.php?id=5  0x00000000004cb7a9 in dummy_start
(data=0x2aaab85e3560) at
utils.c:856

https://issues.asterisk.org/view.php?id=6  0x0000003811806617 in start_thread ()
from /lib64/libpthread.so.0

https://issues.asterisk.org/view.php?id=7  0x00000038110d3c2d in clone () from
/lib64/libc.so.6
<snip>

Regards
Jens 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2010-01-19 07:00 jensvb         Note Added: 0116882                          
======================================================================