[Asterisk-code-review] runtests: Add the ability to run the test suite in a loop (testsuite[master])

[Matt Jordan]

Hello Anonymous Coward #1000019, George Joseph, Corey Farrell,

I'd like you to reexamine a change.  Please visit

    https://gerrit.asterisk.org/1529

to look at the new patch set (#5).

Change subject: runtests: Add the ability to run the test suite in a loop
......................................................................

runtests: Add the ability to run the test suite in a loop

This patch adds a new option to runtests.py, '-n'. This will instruct the
test suite to run its set of tests 'n' number of times. Each result from
an iteration of the test suite is stored as a new <testsuite> node in the
resulting JUnit XML report. If a negative number is provided for the '-n'
option, the Test Suite will run continuously until told to stop.

In order to tell the Test Suite to stop, signal handlers have been added for
the USR1 and USR2 signals.
 - If the USR1 signal is sent to the python process, the Test Suite will stop
   executing any further tests after the current test case completes. Any
   non-executed tests are marked as skipped.
 - If the USR2 signal is sent to the python process, the current executing
   test case is marked as abandoned and failed. Any subsequent tests in the
   current running set of tests are marked as skipped.

This prevents us from having to use a keyboard interrupt to stop the Test
Suite, losing all results.

Change-Id: I6c65250a45e48dc36b7c4657d4cfbe63efeb1a6d
---
M README.txt
M runtests.py
2 files changed, 153 insertions(+), 69 deletions(-)


  git pull ssh://gerrit.asterisk.org:29418/testsuite refs/changes/29/1529/5
-- 
To view, visit https://gerrit.asterisk.org/1529
To unsubscribe, visit https://gerrit.asterisk.org/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I6c65250a45e48dc36b7c4657d4cfbe63efeb1a6d
Gerrit-PatchSet: 5
Gerrit-Project: testsuite
Gerrit-Branch: master
Gerrit-Owner: Matt Jordan <mjordan at digium.com>
Gerrit-Reviewer: Anonymous Coward #1000019
Gerrit-Reviewer: Corey Farrell <git at cfware.com>
Gerrit-Reviewer: George Joseph <george.joseph at fairview5.com>
Gerrit-Reviewer: Matt Jordan <mjordan at digium.com>