<div dir="ltr"><div>That's pretty weird. The ASSERT in frame 4 makes sure that the time difference between the frame's timestamp and the current time is positive so a negative value will cause the assert. Actually, I think there's a bug there. Most asserts in Asterisk are enabled only when it's built with --enable-dev-mode. This assert seems to trigger even without --enable-dev-mode.</div><div><br></div><div>Anyway, if you still have the actual coredump, it'd be interesting to do the following in gdb...</div><div><br></div><div>gdb> frame 6</div><div>gdb> p now</div><div>gdb> p now_tv</div><div>gdb> p *framedata</div><div><br></div><div>I'm wondering if the system time is being slewed backwards by ntpd, chronyd, systemd-timesyncd, etc.</div><div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jun 14, 2021 at 10:49 AM Dan Cropp <<a href="mailto:dan@amtelco.com">dan@amtelco.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US" style="overflow-wrap: break-word;">
<div class="gmail-m_-5560040407888616321WordSection1">
<p class="MsoNormal">We have a customer with asterisk 16.17.0 installed. Every once in a while, we have been seeing a crash. We have upgraded the version a couple times, but this random crashing issue has been going on for some time.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Over the weekend, it happened again. This time, I have a .crash file from it.<u></u><u></u></p>
<p class="MsoNormal">Put it through apport-unpack and think I have a good CoreDump from it.<u></u><u></u></p>
<p class="MsoNormal">Running asterisk 16.17.0 here is what the gdb backtrace is showing.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">Program terminated with signal SIGABRT, Aborted.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">51 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">[Current thread is 1 (Thread 0x7f014097d700 (LWP 20262))]<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">(gdb) bt<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#1 0x00007f027877a921 in __GI_abort () at abort.c:79<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#2 0x00007f027876a48a in __assert_fail_base (fmt=0x7f02788f1750 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x5588ef1864a9 "now >= 0",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> file=file@entry=0x5588ef18645a "fixedjitterbuf.c", line=line@entry=293, function=function@entry=0x5588ef1864f8 <__PRETTY_FUNCTION__.9166> "fixed_jb_get")<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> at assert.c:92<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#3 0x00007f027876a502 in __GI___assert_fail (assertion=assertion@entry=0x5588ef1864a9 "now >= 0", file=file@entry=0x5588ef18645a "fixedjitterbuf.c",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> line=line@entry=293, function=function@entry=0x5588ef1864f8 <__PRETTY_FUNCTION__.9166> "fixed_jb_get") at assert.c:101<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#4 0x00005588eeffe999 in fixed_jb_get (jb=<optimized out>, frame=frame@entry=0x7f01409785c0, now=<optimized out>, interpl=<optimized out>) at fixedjitterbuf.c:293<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#5 0x00005588eef39ee2 in jb_get_fixed (jb=<optimized out>, fout=0x7f0140978628, now=<optimized out>, interpl=<optimized out>) at abstract_jb.c:675<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#6 0x00005588eef3a392 in hook_event_cb (chan=<optimized out>, frame=<optimized out>, event=<optimized out>, data=0x7f017411f4e0) at abstract_jb.c:1127<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#7 0x00005588ef008935 in framehook_list_push_event (framehooks=0x7f01741bca40, frame=frame@entry=0x5588ef416aa0 <ast_null_frame>,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> event=event@entry=AST_FRAMEHOOK_EVENT_READ) at framehook.c:116<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#8 0x00005588ef009177 in ast_framehook_list_read_event (framehooks=<optimized out>, frame=frame@entry=0x5588ef416aa0 <ast_null_frame>) at framehook.c:320<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#9 0x00005588eefbb1b1 in __ast_read (chan=chan@entry=0x7f016c1abf30, dropaudio=dropaudio@entry=0, dropnondefault=dropnondefault@entry=1) at channel.c:3779<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#10 0x00005588eefbd40c in ast_read (chan=chan@entry=0x7f016c1abf30) at channel.c:4285<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#11 0x00007f01cbf77b9c in async_agi_read_frame (chan=0x7f016c1abf30) at res_agi.c:1763<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#12 launch_asyncagi (efd=0x0, argv=0x7f0140978ae8, argc=<optimized out>, chan=0x7f016c1abf30) at res_agi.c:1960<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#13 launch_script (opid=<synthetic pointer>, efd=0x0, fds=0x7f0140978a30, argv=0x7f0140978ae8, argc=<optimized out>, script=<optimized out>, chan=0x7f016c1abf30)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> at res_agi.c:2213<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#14 agi_exec_full (chan=0x7f016c1abf30, data=<optimized out>, enhanced=<optimized out>, dead=0) at res_agi.c:4521<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#15 0x00005588ef04bf92 in pbx_exec (c=c@entry=0x7f016c1abf30, app=app@entry=0x5588efbed4b0, data=data@entry=0x7f014097ac00 "agi:async") at pbx_app.c:492<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#16 0x00005588ef03d062 in pbx_extension_helper (c=c@entry=0x7f016c1abf30, context=0x7f016c1ac8f0 "IS", exten=exten@entry=0x7f016c1ac940 "1234",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> priority=priority@entry=15, label=label@entry=0x0, callerid=callerid@entry=0x0, action=E_SPAWN, found=0x7f014097ccac, combined_find_spawn=1, con=0x0) at pbx.c:2947<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#17 0x00005588ef041143 in ast_spawn_extension (combined_find_spawn=1, found=0x7f014097ccac, callerid=0x0, priority=15, exten=0x7f016c1ac940 "1234",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black"> context=<optimized out>, c=0x7f016c1abf30) at pbx.c:4206<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#18 __ast_pbx_run (c=c@entry=0x7f016c1abf30, args=args@entry=0x0) at pbx.c:4380<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#19 0x00005588ef04282b in pbx_thread (data=data@entry=0x7f016c1abf30) at pbx.c:4704<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#20 0x00005588ef0cf41f in dummy_start (data=<optimized out>) at utils.c:1299<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#21 0x00007f02793216db in start_thread (arg=0x7f014097d700) at pthread_create.c:463<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:9pt;font-family:Arial,sans-serif;color:black">#22 0x00007f027885b71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Any suggestions of what I could try?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Dan<u></u><u></u></p>
</div>
</div>
-- <br>
_____________________________________________________________________<br>
-- Bandwidth and Colocation Provided by <a href="http://www.api-digital.com" rel="noreferrer" target="_blank">http://www.api-digital.com</a> --<br>
<br>
asterisk-dev mailing list<br>
To UNSUBSCRIBE or update options visit:<br>
<a href="http://lists.digium.com/mailman/listinfo/asterisk-dev" rel="noreferrer" target="_blank">http://lists.digium.com/mailman/listinfo/asterisk-dev</a></blockquote></div></div>