[asterisk-commits] runtests.py: Add parameter --random-order. (testsuite[master])

[SVN commits to the Asterisk project]

Matt Jordan has submitted this change and it was merged.

Change subject: runtests.py: Add parameter --random-order.
......................................................................


runtests.py: Add parameter --random-order.

This adds a parameter to runtests.py that allows the tests to be run
in a randomized order instead of alphabetically.  This can be useful
when testing a change to the Asterisk that requires running the full
testsuite.  For example if the change breaks rest_api, you will not
have to wait for 80% of the testsuite to run before those tests start
to produce failures.

Change-Id: I002c6fa2c7a05e44673cb56b11d4e4c381f3eba0
---
M runtests.py
1 file changed, 8 insertions(+), 2 deletions(-)

Approvals:
  Kevin Harwell: Looks good to me, but someone else must approve
  Matt Jordan: Looks good to me, approved; Verified



diff --git a/runtests.py b/runtests.py
index 17d7ff7..a8a84c9 100755
--- a/runtests.py
+++ b/runtests.py
@@ -341,8 +341,11 @@
 
         self.tests = []
         self.global_config = self._parse_global_config()
-        self.tests = sorted(self._parse_test_yaml("tests", ast_version),
-                            key=lambda test: test.test_name)
+        self.tests = self._parse_test_yaml("tests", ast_version)
+        if self.options.randomorder:
+            random.shuffle(self.tests)
+        else:
+            self.tests = sorted(self.tests, key=lambda test: test.test_name)
         self.total_time = 0.0
         self.total_count = 0
         self.total_failures = 0
@@ -609,6 +612,9 @@
     parser.add_option("-c", "--cleanup", action="store_true",
                       dest="cleanup", default=False,
                       help="Cleanup tmp directory after each successful test")
+    parser.add_option("--random-order", action="store_true",
+                      dest="randomorder", default=False,
+                      help="Shuffle the tests so they are run in random order")
     (options, args) = parser.parse_args(argv)
 
     ast_version = AsteriskVersion(options.version)

-- 
To view, visit https://gerrit.asterisk.org/550
To unsubscribe, visit https://gerrit.asterisk.org/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I002c6fa2c7a05e44673cb56b11d4e4c381f3eba0
Gerrit-PatchSet: 2
Gerrit-Project: testsuite
Gerrit-Branch: master
Gerrit-Owner: Corey Farrell <git at cfware.com>
Gerrit-Reviewer: Corey Farrell <git at cfware.com>
Gerrit-Reviewer: Kevin Harwell <kharwell at digium.com>
Gerrit-Reviewer: Matt Jordan <mjordan at digium.com>
Gerrit-Reviewer: Richard Mudgett <rmudgett at digium.com>