Skip to content

[BASOP CI] Add MLD limit to give pass for tests below limit

norvell requested to merge ci/mld-jobs-with-tolerance-limit into main

Tagging @kiene, @pihlajakuja, @bohmr

In the BASOP CI, the test still checks for bit exactness. Since the BASOP is expected to give a difference in the output, practically all tests will fail as the conversion progresses. For each failed test the output is captured and put into the log, and the log quickly reaches the size limit.

To improve this, I suggest to use a limit on the MLD values, and let the tests pass if the MLD is below this limit. Based on the EVS Float/BASOP test, I suggest MLD<2 for decoder jobs and MLD<5 for encoder+decoder jobs.

The previous MLD parsing relied on the captured output for failed tests. If the tests do not fail no output is collected. Instead, the MLD value is included in the junit report as a property. This required some additional fixes to the tests, passing the record_property argument.

The changes should not have any effect on the IVAS PC, but enables the setting of the ´mld-lim ` option for the jobs in the IVAS BASOP repo.

Merge request reports