[asterisk-bugs] [Asterisk 0015997]: segfault in 1.6.1.6 in _ao2_find, called from chan_iax2 after approx. 75.000 calls

[Asterisk Bug Tracker]

A NOTE has been added to this issue. 
====================================================================== 
https://issues.asterisk.org/view.php?id=15997 
====================================================================== 
Reported By:                exarv
Assigned To:                russell
====================================================================== 
Project:                    Asterisk
Issue ID:                   15997
Category:                   Channels/chan_iax2
Reproducibility:            have not tried
Severity:                   crash
Priority:                   normal
Status:                     assigned
Asterisk Version:           1.6.1.6 
JIRA:                        
Regression:                 No 
SVN Branch (only for SVN checkouts, not tarball releases): N/A 
SVN Revision (number only!):  
Request Review:              
====================================================================== 
Date Submitted:             2009-10-01 02:37 CDT
Last Modified:              2009-10-05 05:34 CDT
====================================================================== 
Summary:                    segfault in 1.6.1.6 in _ao2_find, called from
chan_iax2 after approx. 75.000 calls
Description: 
I'm running Asterisk 1.6.1.6 since 19 days now,
but I've had 3 times a segfault on the same address.

Sep 17 13:03:57 switch02 kernel: asterisk[13597]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 00000000420b1440 error 4
     In the mean time 75.517 calls were setup.
Sep 22 19:07:13 switch02 kernel: asterisk[23982]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 0000000042142440 error 4
     In the mean time  76.725 calls were setup.
Sep 28 14:26:16 switch02 kernel: asterisk[2777]: segfault at 
00002aaa0000000a rip 0000000000435c36 rsp 0000000042088440 error 4

It's a live server running production traffic. So I don't have much 
possibilities to easily test a different version.
Also the issue only happens to me once a week (about once every approx. 
75.000 calls).
The segfault didn't happen on the most busiest times (sunday), but just 
on the more quiet days.

The last time the server had 50 calls, 97 channels (43 chan_ss7 
channels, 46 sip channels and 8 iax2 channels)

Software running:
  - CentOS 5 (latest updates as of 11 sept 2009)
  - asterisk 1.6.1.6
  - chan_ss7 1.2.1
  - dahdi-linux 2.2.0.2
  - dahdi-tools 2.2.0
  - wanpipe 3.5.6



====================================================================== 

---------------------------------------------------------------------- 
 (0111836) exarv (reporter) - 2009-10-05 05:34
 https://issues.asterisk.org/view.php?id=15997#c111836 
---------------------------------------------------------------------- 
Some information from the asterisk manager about the iax channel that
crashed:

'Event' => 'Newchannel'
'Channel' => 'IAX2/internal_switch01-17150'
'ChannelState' => '0'
'ChannelStateDesc' => 'Down'
'CallerIDNum' => false
'CallerIDName' => false
'AccountCode' => false
'Uniqueid' => '1254734360.127385'

'Event' => 'ChannelUpdate'
'Channel' => false
'Channeltype' => 'IAX2'
'IAX2-callno-local' => '17150'
'IAX2-callno-remote' => '0'
'IAX2-peer' => false

'Event' => 'Newstate'
'Channel' => 'IAX2/internal_switch01-17150'
'ChannelState' => '5'
'ChannelStateDesc' => 'Ringing'
'CallerIDNum' => '4915xxxxxxxxx'
'CallerIDName' => 'xxxxxxxxxxxxx'
'Uniqueid' => '1254734360.127385'

'Event' => 'Dial'
'SubEvent' => 'Begin'
'Channel' => 'SIP/xxxxxxxx-c81678d8'
'Destination' => 'IAX2/internal_switch01-17150'
'CallerIDNum' => '4915xxxxxxxxx'
'CallerIDName' => 'xxxxxxxxxxxxx'
'UniqueID' => '1254734284.127360'
'DestUniqueID' => '1254734360.127385'
'Dialstring' => 'internal_switch01/89986xxxxxxxxxxx'

'Event' => 'NewCallerid'
'Channel' => 'IAX2/internal_switch01-17150'
'CallerIDNum' => '004969xxxxxxxx'
'CallerIDName' => false,
'Uniqueid' => '1254734360.127385'
'CID-CallingPres' => '0 (Presentation Allowed, Not Screened)' 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2009-10-05 05:34 exarv          Note Added: 0111836                          
======================================================================