Add EVS self_test to MR pipeline and correct bug in case self_test.py fails and self_test_b.py passes (!130) · Merge requests · IVAS Codec Public Collaboration / IVAS Codec

norvell requested to merge 112-add-self_test_evs-prm-to-mr-pipeline-not-allowed-to-fail into main Sep 16, 2022

I think this should do the trick. Now the self_test.py with self_test_evs.prm is also run. As for the IVAS test cases, it is allowed to fail if the MR contains the tag [EVS non be]. I guess these cases are quite rare, but may happen if we fix things in EVS.

To me the logic around the final results looks wrong. It seems that a EXIT_CODE_FAIL can be changed to EXIT_CODE_NON_BE in case self_test_b.py passes with Non-BE differences that are tolerated.

Admin message

Add EVS self_test to MR pipeline and correct bug in case self_test.py fails and self_test_b.py passes

Merge request reports