Customizable test case outcomes (aka verdicts)
|Reported by:||Roberto Longobardi||Owned by:||Roberto Longobardi|
|Cc:||Ryan J Ollos, manolowolder||Trac Release:||0.11|
It would be cool, if one could define a set of possible verdicts.
You have "Successful", "Untested", and "Failed",
which is OK for many purposes. But if you do tests according to one of the many standards, you might have different needs. E.g. ISO-9646 has five verdicts:
None = no result yet, untested Pass = good, successful Inconc = inconclusive, unclear Fail = bad, failed Error = there was an error in performing the test
If you test according to POSIX 1003.3 you have the verdicts:
PASS = good, successful FAIL = bad, failed UNRESOLVED = inconclusive, unclear UNTESTED = no result yet, untested
Some testing frameworks add XFAIL (= expected fail), UPASS (= unexpected pass) and UNSUPPORTED (= the implementation under test doesn't support a feature) to the POSIX verdicts.