When you execute tests through SeqZap you are of course interested in the results of the test. To get the results you use the data type Verdict, and the results of your test can have one of the following values or verdicts:
- UNSET (grey), means that the test is completed but with no test result.
- PASS (green), means that the test is completed with a satisfying result and lies within the expected values in terms of specification of requirements.
- FAIL (red), means that the expectations of the test were not met and that the result lies outside of the specification of requirements.
- INCONCLUSIVE (yellow), means that the test has not generated sufficient data to provide you with a result (occurs rarely).
- ERROR (yellow), means that there is an error in your test-setup or test environment.
NOTE It is important to distinguish between the different results and especially the difference between FAIL and ERROR. You will receive the value FAIL when your SUT does not return the value that is expected and therefore does not reply as expected, whereas you will receive the value ERROR when your test cannot be completed due to an error. An error can be due to different things such as communication failure with your SUT, internal failures in your script file or in SeqZap, or different preconditions for your test are not in place.