[asterisk-bugs] [JIRA] (ASTERISK-26551) Voicemail deadlock when under load with ODBC backend

[David Moore (JIRA)]

     [ https://issues.asterisk.org/jira/browse/ASTERISK-26551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Moore updated ASTERISK-26551:
-----------------------------------

    Attachment: 2016-11-09-23_28_59-locks
                2016-11-09-23_28_59-debug
                2016-11-09-23_28_59-channels
                2016-11-09-23_28_59-backtrace

backtrace, core show channels, core show locks, and debug log for the last deadlock, taken after more than 30 minutes of lockage

core show locks does not have useful information, asterisk did not output it

all channels listed in 'core show channels' output are defunct and long since gone away



> Voicemail deadlock when under load with ODBC backend
> ----------------------------------------------------
>
>                 Key: ASTERISK-26551
>                 URL: https://issues.asterisk.org/jira/browse/ASTERISK-26551
>             Project: Asterisk
>          Issue Type: Bug
>      Security Level: None
>          Components: Applications/app_voicemail, Applications/app_voicemail/ODBC
>    Affects Versions: 13.11.2
>         Environment: Up to date Debian 8
> chan_pjsip
> Cloned a production server and enabled debug then setup automated tests to keep the voicemail system under load in order to reproduce this bug.
>            Reporter: David Moore
>            Assignee: Unassigned
>         Attachments: 2016-11-09-00_27_31-backtrace, 2016-11-09-00_27_31-channels, 2016-11-09-00_27_31-debug, 2016-11-09-00_27_31-locks, 2016-11-09-23_28_59-backtrace, 2016-11-09-23_28_59-channels, 2016-11-09-23_28_59-debug, 2016-11-09-23_28_59-locks, backtrace-threads10.txt, core-show-locks10.txt, dialplan.txt, odbc_show_all.txt
>
>
> Voicemail-only server (answering incoming calls from peer with chan_pjsip)
> Bug can be reproduced by placing the voicemail system under load, I did this by leaving many simultaneous voicemails through automated means. After running for several hours the voicemail app locks up. The system will still accept incoming calls, and enter the Voicemail app, but no audio is returned and the call does not progress further.
> The system eventually recovers and resumes normal operation, this generally takes between 3 and 20 minutes.
> I took ten backtraces and ten copies of 'core show locks' during this deadlock on my debug server, I can upload all of them if necessary, I will begin by attaching the latest data set and will upload more upon request to avoid cluttering things up unnecessarily



--
This message was sent by Atlassian JIRA
(v6.2#6252)