[asterisk-dev] [Code Review]: Reimplement 'skip' property for testsuite

[opticron]

> On April 13, 2012, 10:37 a.m., Matt Jordan wrote:
> > asterisk/trunk/lib/python/asterisk/version.py, lines 253-259
> > <https://reviewboard.asterisk.org/r/1796/diff/2/?file=27205#file27205line253>
> >
> >     This could use some more unit tests.  Things the unit tests should confirm:
> >     
> >     1. Need to confirm that we can parse the 10-digiumphones branch
> >     2. What do we do if the phonesbranch doesn't have a parent branch?  Currently, the 10-digiumphones branch does not, as it hasn't had anything merged into it.
> >     3. How do we compare 1.8 to 1.8-digiumphones?  Currently, this treats 1.8-digiumphones as if it were 1.8.  That would imply that the comparison would rely on subversion revision numbers to determine if something is less than or greater than another branch.  Should the 1.8 branch ever be greater then 1.8-digiumphones?
> >
> 
> Paul Belanger wrote:
>     1) Adding, since 10-digiumphones didn't exist when I started.
>     2) Not sure I understand
>     3) That is the $100 question, which branch is greater?  I mentioned before, I think they are parallel branches, meaning they should not be compared.  Will need some feedback for this.

2) If you build 10-digiumphones right now, the version string you get is "SVN-branch-10-digiumphones-r362674".  There is no parent identifier after the revision.
3) I agree that they should not be compared.  I would expect minversion to operate only on the numeric portion of the branch.  This should allow existing testsuite tests to work against both 1.8 and 1.8-digiumphones (or the 10 variants for that matter) without modification and future tests can exclude the base branches or digiumphones branches as necessary.


- opticron


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviewboard.asterisk.org/r/1796/#review5988
-----------------------------------------------------------


On April 19, 2012, 11:11 a.m., Paul Belanger wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviewboard.asterisk.org/r/1796/
> -----------------------------------------------------------
> 
> (Updated April 19, 2012, 11:11 a.m.)
> 
> 
> Review request for Asterisk Developers.
> 
> 
> Summary
> -------
> 
> I'm looking for some initial feedback on the following patch.  Since we have the digiumphones branch now, we need to rework on the testsuite handles asterisk versions.  Before we used minversion / maxversion (which worked across branches) however this does not work well if you have a parallel branch.
> 
> So, I've removed them in favour of 'skip'.  Basically, the testsuite will run on every version of asterisk unless you have 'skip' defined, then depending on the flag (right now branch) it checks to run or skip the test.
> 
> We currently use the 'skip' flag, but only for a basic check.  At the moment to skip broken tests, this new method would give us more control on the type of tests to skip.  EG: Skip if OS is FreeBSD or skip if arch is i386.
> 
> 
> Diffs
> -----
> 
>   asterisk/trunk/lib/python/asterisk/TestConfig.py 3176 
>   asterisk/trunk/lib/python/asterisk/version.py 3176 
>   asterisk/trunk/runtests.py 3176 
>   asterisk/trunk/tests/channels/SIP/message_auth/test-config.yaml 3176 
>   asterisk/trunk/tests/channels/SIP/message_unauth/test-config.yaml 3176 
> 
> Diff: https://reviewboard.asterisk.org/r/1796/diff
> 
> 
> Testing
> -------
> 
> Local dev box.
> 
> There is also more work needed to be done in updating the test-config.yaml files, however I want to get this patch reviewed before making all those changes.
> 
> 
> Thanks,
> 
> Paul
> 
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.digium.com/pipermail/asterisk-dev/attachments/20120420/7ceeba88/attachment-0001.htm>