[asterisk-bugs] [JIRA] (ASTERISK-25099) res_rtp_asterisk: Crash when using DTLS

[Robert Moss (JIRA)]

     [ https://issues.asterisk.org/jira/browse/ASTERISK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Moss updated ASTERISK-25099:
-----------------------------------

    Description: 
After running for a while, sometimes 5 minutes, sometimes a few hours, but typically multiple times per day, asterisk segfaults, with no hint as to why in the logs. I've checked many backtraces, they are almost all in malloc. One was in another libc module, so i reinstall glibc and haven't seen that one since.

The most recent SF'd in free()

I have uploaded the backtrace here: http://hackrr.com/files/backtrace518b.txt (7:29am)
I have uploaded the debug log here:
http://hackrr.com/files/mydebug.log
and here:
http://hackrr.com/files/mydebug.log.gz
Here is a screenshot of the segfault in the terminal (same tty that started amportal)
http://hackrr.com/files/segfault.png

Update: Here is the 2nd crash of the day. Segmentation fault, address OOB. http://hackrr.com/files/backtrace518-10a.txt  (9:29am)
Update: Here is the 3rd crash of the day. "Aborted" http://hackrr.com/files/backtrace518-1049a.txt (10:49am) (this time it crashed in openssl, so probably different from above SF's but idk...) (open ssl version: OpenSSL 1.0.1k-fips 8 Jan 2015 ) I'm guessing a NULL or invalid pointer was passed to openssl... so back to memory corruption

I am using freepbx, however I compiled asterisk myself, with-srtp, with-uuid, with-ssl, and with-crypto. This is for WebRTC, everything works fine except for the segfaults. Yes, I deleted /usr/lib/asterisk/modules before installing the new version.

Sorry sip/rtp debugging are not in this file, if you think it will help I can do it again. I did it with other core dumps without BETTER_BACKTRACES and DONT_OPTIMIZE, but there was no useful info there, and i forgot to enable this morning with those flags setup.

This is an AWS / Amazon instance. I have run "memtester" in userspace to test the RAM, it found nothing, however I know it's not as good as a kernel level memtest. However I haven't noticed any issues in other software. 

I am going to fire up a new instance and start from scratch and see if that helps in any way.

  was:
After running for a while, sometimes 5 minutes, sometimes a few hours, but typically multiple times per day, asterisk segfaults, with no hint as to why in the logs. I've checked many backtraces, they are almost all in malloc. One was in another libc module, so i reinstall glibc and haven't seen that one since.

The most recent SF'd in free()

I have uploaded the backtrace here: http://hackrr.com/files/backtrace518b.txt (7:29am)
I have uploaded the debug log here:
http://hackrr.com/files/mydebug.log
and here:
http://hackrr.com/files/mydebug.log.gz
Here is a screenshot of the segfault in the terminal (same tty that started amportal)
http://hackrr.com/files/segfault.png

Update: Here is the 2nd crash of the day. Segmentation fault, address OOB. http://hackrr.com/files/backtrace518-10a.txt  (9:29am)
Update: Here is the 3rd crash of the day. "Aborted" http://hackrr.com/files/backtrace518-1049a.txt (10:49am) (this time it crashed in openssl, so probably different from above SF's but idk...) (open ssl version: OpenSSL 1.0.1k-fips 8 Jan 2015 ) I'm guessing a NULL or invalid pointer was passed to openssl... so back to memory corruption

I am using freepbx, however I compiled asterisk myself, with-srtp, with-uuid, with-ssl, and with-crypto. This is for WebRTC, everything works fine except for the segfaults. Yes, I deleted /usr/lib/asterisk/modules before installing the new version.

Sorry sip/rtp debugging are not in this file, if you think it will help I can do it again. I did it with other core dumps without BETTER_BACKTRACES and DONT_OPTIMIZE, but there was no useful info there, and i forgot to enable this morning with those flags setup.


> res_rtp_asterisk: Crash when using DTLS
> ---------------------------------------
>
>                 Key: ASTERISK-25099
>                 URL: https://issues.asterisk.org/jira/browse/ASTERISK-25099
>             Project: Asterisk
>          Issue Type: Bug
>      Security Level: None
>          Components: Resources/res_rtp_asterisk
>    Affects Versions: 11.17.1
>         Environment: [Amazon AWS] Linux  3.14.23-22.44.amzn1.x86_64 #1 SMP Tue Nov 11 23:07:48 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
>            Reporter: Robert Moss
>         Attachments: backtrace518-1049a.txt, backtrace518-10a.txt, backtrace518b.txt, mydebug.log.gz
>
>
> After running for a while, sometimes 5 minutes, sometimes a few hours, but typically multiple times per day, asterisk segfaults, with no hint as to why in the logs. I've checked many backtraces, they are almost all in malloc. One was in another libc module, so i reinstall glibc and haven't seen that one since.
> The most recent SF'd in free()
> I have uploaded the backtrace here: http://hackrr.com/files/backtrace518b.txt (7:29am)
> I have uploaded the debug log here:
> http://hackrr.com/files/mydebug.log
> and here:
> http://hackrr.com/files/mydebug.log.gz
> Here is a screenshot of the segfault in the terminal (same tty that started amportal)
> http://hackrr.com/files/segfault.png
> Update: Here is the 2nd crash of the day. Segmentation fault, address OOB. http://hackrr.com/files/backtrace518-10a.txt  (9:29am)
> Update: Here is the 3rd crash of the day. "Aborted" http://hackrr.com/files/backtrace518-1049a.txt (10:49am) (this time it crashed in openssl, so probably different from above SF's but idk...) (open ssl version: OpenSSL 1.0.1k-fips 8 Jan 2015 ) I'm guessing a NULL or invalid pointer was passed to openssl... so back to memory corruption
> I am using freepbx, however I compiled asterisk myself, with-srtp, with-uuid, with-ssl, and with-crypto. This is for WebRTC, everything works fine except for the segfaults. Yes, I deleted /usr/lib/asterisk/modules before installing the new version.
> Sorry sip/rtp debugging are not in this file, if you think it will help I can do it again. I did it with other core dumps without BETTER_BACKTRACES and DONT_OPTIMIZE, but there was no useful info there, and i forgot to enable this morning with those flags setup.
> This is an AWS / Amazon instance. I have run "memtester" in userspace to test the RAM, it found nothing, however I know it's not as good as a kernel level memtest. However I haven't noticed any issues in other software. 
> I am going to fire up a new instance and start from scratch and see if that helps in any way.



--
This message was sent by Atlassian JIRA
(v6.2#6252)