Skip to content

Apple Clang 16 Release vs Debug differences in OSBA

Commit SHA: 32c65a1d (probably)

This issue shows differences in Release vs. Debug build run of short self-test on Mac M4, OS version 15.6.1, Apple Clang 16. This was discussed in IVAS conformance call on Monday September 22nd.

This is the issue for OSBA format. Some larger differences with maximum being 1220.

Test showed these results

FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 2OA 2ISM at 64 kbps, 32kHz in, 16kHz out, BINAURAL ROOM REVERB out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 4)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 2OA 2ISM bitrate switching, 32kHz in, 48kHz out, BINAURAL_ROOM_REVERB out, JBM Prof 5] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 180)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 2OA 3ISM at 96 kbps, 48kHz in, 48kHz out, STEREO out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 5)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 2OA 4ISM at 384 kbps, 48kHz in, 48kHz out, BINAURAL out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 651)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3ISM 2OA at bitrate switching 13.2 to 512 kbps, 48kHz in, 32kHz out, STEREO out, FER at 10%] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 3)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3ISM 3OA at bitrate switching 13.2 to 512 kbps, 48kHz in, 32kHz out, BINAURAL ROOM REVERB out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 42)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 3ISM at 128 kbps, 48kHz in, 48kHz out, BINAURAL out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 147)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM at 48 kbps, 48kHz in, 48kHz out, BINAURAL_ROOM_REVERB out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 1)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM at 512 kbps, 48kHz in, 48kHz out, BINAURAL_ROOM_REVERB out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 677)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM at 64 kbps, 48kHz in, 48kHz out, BINAURAL_ROOM_REVERB out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 1)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM bitrate switching 13.2 to 512, 32kHz in, 48kHz out, EXT out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 1)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM bitrate switching 13.2 to 512, 48kHz in, 48kHz out, BINAURAL out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 407)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA 3OA 4ISM bitrate switching 16.4 to 512, 48kHz in, 48kHz out, BINAURAL out, headtracking] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 127)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA FOA 2ISM at 64 kbps, 48kHz in, 48kHz out, HOA3 out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 23)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA FOA 4ISM at 512 kbps, 48kHz in, 48kHz out, BINAURAL (Model from file) out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 649)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA FOA 4ISM at br sw 13.2 to 512 kbps, 48kHz in, 16kHz out, BINAURAL out (Model from file), FER at 5%, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 1220)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA planar 2OA 4ISM at 512 kbps, 48 kHz in, 48 kHz out, BINAURAL ROOM REVERB (Model from file) out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 662)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA planar FOA 1ISM at 256 kbps, 48 kHz in, 48 kHz out, BINAURAL out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 174)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-OSBA planar FOA 2ISM at 512 kbps, 48 kHz in, 48 kHz out, BINAURAL out] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 163)

Build and tests were done with

cmake . -Bbuild-debug
cmake --build build-debug -- -j
cmake . -Bbuild-release -DCMAKE_BUILD_TYPE=Release
cmake --build build-release -- -j
pytest tests/codec_be_on_mr_nonselection -v --update_ref 1 --ref_encoder_path=./build-debug/IVAS_cod --ref_decoder_path=./build-debug/IVAS_dec
pytest tests/codec_be_on_mr_nonselection -v --update_ref 0 --dut_encoder_path=./build-release/IVAS_cod --dut_decoder_path=./build-release/IVAS_dec