[asterisk-bugs] [JIRA] (ASTERISK-24379) Testsuite: Process REF_DEBUG logs, fail any test that leaks

[Corey Farrell (JIRA)]

    [ https://issues.asterisk.org/jira/browse/ASTERISK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=222875#comment-222875 ] 

Corey Farrell commented on ASTERISK-24379:
------------------------------------------

It's worth noting that this has the side effect of failing any test that does not successfully {{core stop gracefully}}.  I'm just ran testsuite with this patch for {{tests/channels/SIP}}.  The following is a list of leaked object count per instance of asterisk:
{code}
$ grep `find logs/channels/SIP -name refs.txt|sort` -e 'Leaked Object '|sed -e 's/:.*//'|uniq -c
  34059 logs/channels/SIP/hangupcause/run_1/ast1/var/log/asterisk/refs.txt
     11 logs/channels/SIP/message_from_call/run_1/ast1/var/log/asterisk/refs.txt
     10 logs/channels/SIP/noload_res_srtp_attempt_srtp/run_1/ast2/var/log/asterisk/refs.txt
  34063 logs/channels/SIP/noload_res_srtp/run_1/ast1/var/log/asterisk/refs.txt
  34062 logs/channels/SIP/noload_res_srtp/run_1/ast2/var/log/asterisk/refs.txt
     10 logs/channels/SIP/SDP_offer_answer/run_1/ast1/var/log/asterisk/refs.txt
  34066 logs/channels/SIP/secure_bridge_media/run_1/ast1/var/log/asterisk/refs.txt
  34046 logs/channels/SIP/secure_bridge_media/run_1/ast2/var/log/asterisk/refs.txt
  34059 logs/channels/SIP/sip_cause/run_1/ast1/var/log/asterisk/refs.txt
  34046 logs/channels/SIP/sip_srtp/run_1/ast1/var/log/asterisk/refs.txt
  34065 logs/channels/SIP/sip_srtp/run_1/ast2/var/log/asterisk/refs.txt
     11 logs/channels/SIP/subscribe/run_1/ast1/var/log/asterisk/refs.txt
{code}

Totals: 81 tests run, 4 failed due to actual reference leaks, 8 failed due to shutdown timeout, 28 skipped tests (I don't have pjsua or the correct sipp).  So it looks like we can't enable {{REF_DEBUG}} with this patch for the default build agent job even for Asterisk 11, as it will cause failures in every run that are due to testsuite errors rather than Asterisk leaks.  I do think there would be value in having an alternate job run against Asterisk 11 (maybe once per week) to give the community a published report of all tests that don't result in clean shutdown free of reference leaks.

> Testsuite: Process REF_DEBUG logs, fail any test that leaks
> -----------------------------------------------------------
>
>                 Key: ASTERISK-24379
>                 URL: https://issues.asterisk.org/jira/browse/ASTERISK-24379
>             Project: Asterisk
>          Issue Type: Bug
>      Security Level: None
>          Components: Tests/testsuite
>    Affects Versions: SVN, 11.13.0, 12.6.0, 13.0.0-beta2
>            Reporter: Corey Farrell
>            Assignee: Corey Farrell
>
> The testsuite should process REF_DEBUG logs if produced, fail any test where Asterisk leaked references.



--
This message was sent by Atlassian JIRA
(v6.2#6252)