[asterisk-users] Help with asterisk core dump

[Miguel Molina]

Hi to all,

I recently upgraded a production machine to asterisk 1.4.25. It seems 
quite stable but after ~5 days of normal operation it core dumped with 
this result:

(gdb) bt
#0  0x00516402 in __kernel_vsyscall ()
#1  0x005b3d20 in raise () from /lib/libc.so.6
#2  0x005b5631 in abort () from /lib/libc.so.6
#3  0x005ebe6b in __libc_message () from /lib/libc.so.6
#4  0x005f3b16 in _int_free () from /lib/libc.so.6
#5  0x005f7070 in free () from /lib/libc.so.6
#6  0x005e2876 in fclose@@GLIBC_2.1 () from /lib/libc.so.6
#7  0x0809eb2a in filestream_destructor (arg=0xb1f0f200) at file.c:340
#8  0x0806e412 in ao2_ref (user_data=0xb1f0f200, delta=-1) at astobj2.c:229
#9  0x0809c1e9 in ast_closestream (f=0xb1f0f200) at file.c:902
#10 0x00b03422 in local_ast_moh_stop (chan=0xb2150fd0) at 
res_musiconhold.c:1058
#11 0x00a6e510 in sip_indicate (ast=0xb2150fd0, condition=17, data=0x0, 
datalen=0) at chan_sip.c:4049
#12 0x08081512 in ast_indicate_data (chan=0xb2150fd0, _condition=17, 
data=0x0, datalen=0) at channel.c:2530
#13 0x08081728 in ast_indicate (chan=0xb2150fd0, condition=17) at 
channel.c:2475
#14 0x0097fd33 in agent_new (p=0x950fef0, state=0) at chan_agent.c:1139
#15 0x009837cf in agent_request (type=0xb55fc9b4 "Agent", format=2, 
data=0xb55fc9ba, cause=0xb55fcacc) at chan_agent.c:1469
#16 0x0807d897 in ast_request (type=0xb55fc9b4 "Agent", format=2, 
data=0xb55fc9ba, cause=0xb55fcacc) at channel.c:3203
#17 0x00b62d13 in ring_entry (qe=0xb55fed00, tmp=0x98397f8, 
busies=0xb55fec44) at app_queue.c:1921
#18 0x00b639c0 in ring_one (qe=0xb55fed00, outgoing=0x9496d60, 
busies=0xb55fec44) at app_queue.c:2071
#19 0x00b6c670 in try_calling (qe=0xb55fed00, options=<value optimized 
out>, announceoverride=0x0, url=0x0, tries=0xb55feea0, 
noption=0xb55fee9c, agi=0x0) at app_queue.c:2960
#20 0x00b6fdca in queue_exec (chan=0x96e44b8, data=0xb5600f28) at 
app_queue.c:4083
#21 0x080ca6eb in pbx_extension_helper (c=0x96e44b8, con=0x0, 
context=0x96e4638 "electr-cola-distribucion", exten=0x96e4688 "51115", 
priority=3, label=0x0, callerid=0x958ae58 "53654664", action=E_SPAWN) at 
pbx.c:537
#22 0x080cd0b1 in __ast_pbx_run (c=0x96e44b8) at pbx.c:2320
#23 0x080ce1fe in pbx_thread (data=0x96e44b8) at pbx.c:2636
#24 0x080fdfbb in dummy_start (data=0x9e11c38) at utils.c:856
#25 0x0070446b in start_thread () from /lib/libpthread.so.0
#26 0x0065bdbe in clone () from /lib/libc.so.6

It looks like a very random situation, as this was not a high load moment.

Also the asterisk log showed this message in the exact instant of the 
failure:

[Jun  8 13:21:13] ERROR[21601] astobj2.c: refcount -1 on object 0xb1f0f200


I understand that a core dump generated by asterisk compiled with 
(standard) optimized values is marked as useless information, but IMHO 
it still helps to know what's failing inside it. I appreciate any input 
about this, could be this a bug? A library problem? Or a server memory 
problem?

Thanks in advance,

-- 
Ing. Miguel Molina
Grupo de Tecnología
Millenium Phone Center