BASOP BE conformance test on windows: non-BE cases

Basic info

• Float reference: 3a3a2ce7

Bug description

Running the BE conformance test for BASOP main on windows 11, VS 2017 against the reference testvectors created on Ubuntu 24.04 clang 18, showed the following failures for me.

The frst batch is errors due to "Output differs"

FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv1ISM48s.wav_1_ISM_with_metadata_at_96_kbps_48_kHz_in_16_kHz_out_EXT_out_bandwidth_switching.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv2ISM48s.wav_2_ISM_with_metadata_at_64_kbps_48_kHz_in_32_kHz_out_EXT_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv32c.wav_1_ISM_with_metadata_bitrate_switching_from_13_2_kbps_to_128_kbps_32_kHz_in_32_kHz_out_EXT_out_DTX_on.dec.wav.0.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stvST48c.wav_stereo_bitrate_switching_from_13_2_kbps_to_128_kbps_48kHz_in_48kHz_out_DTX_on_EXT_out_rtpdump.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv1ISM48s.wav_1_ISM_with_metadata_at_13_2_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stv4ISM48s.wav_4_ISM_with_metadata_bitrate_switching_from_24_4_kbps_to_512_kbps_48_kHz_in_48_kHz_out_DTX_on_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stv51MC48c.wav_Multi_channel_5_1_bitrate_switching_from_13_2_kbps_to_512_kbps_48kHz_in_48kHz_out_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv20sOMASA_1ISM2TC.wav_OMASA_vdir2TC_1ISM_at_128_kbps_48kHz_in_48kHz_out_EXT_out_bandwidth_switching.dec.wav.met] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stvOSBA_2ISM_2OA48c.wav_OSBA_2ISM_2OA_at_bitrate_switching_13_2_to_512_kbps_48kHz_in_48kHz_out_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv20sOMASA_4ISM2TC.wav_OMASA_vdir2TC_4ISM_at_384_kbps_48kHz_in_48kHz_out_EXT_out.dec.wav.met] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv2ISM48s.wav_2_ISM_with_metadata_at_48_kbps_48_kHz_in_48_kHz_out_EXT_out_random_FER_at_5_.dec.wav.1.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stv20sOMASA_3ISM2TC.wav_OMASA_vdir2TC_3ISM_at_br_sw_techs_13_2_to_512_kbps_start_160_kbps_48kHz_in_48kHz_out_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv3ISM48s.wav_3_ISM_with_metadata_at_48_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav.2.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv3ISM48s.wav_3_ISM_with_metadata_at_64_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav.0.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stvFOA48c.wav_SBA_FOA_bitrate_switching_from_13_2_kbps_to_512_kbps_48kHz_in_48kHz_out_DTX_on_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stv2MASA2TC48c.wav_MASA_2dir_2TC_bitrate_switching_from_13_2_kbps_to_512_kbps_48kHz_in_48kHz_out_DTX_on_BINAURAL_out_rtpdump_PI_data.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv3ISM48s.wav_3_ISM_with_metadata_at_96_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stvST48c.wav_Stereo_downmix_to_bit_exact_EVS_at_24400_kbps_48kHz_in_48kHz_out_rtpdump.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_enc.txt--stv48c.wav_EVS_at_13_2_kbps_48kHz_in_48kHz_out_STEREO_out_rtpdump.192] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv4ISM48s.wav_4_ISM_with_metadata_bitrate_switching_from_24_4_kbps_to_256_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav.3.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv4ISM48s.wav_4_ISM_with_metadata_at_128_kbps_48_kHz_in_48_kHz_out_EXT_out_bandwidth_switching.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stvOSBA_1ISM_3OA48c.wav_OSBA_3OA_1ISM_at_512_kbps_48kHz_in_48kHz_out_EXT_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv4ISM48s.wav_4_ISM_with_metadata_at_256_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav.3.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv4ISM48s.wav_4_ISM_with_metadata_at_96_kbps_48_kHz_in_48_kHz_out_EXT_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stvOSBA_4ISM_3OA32c.wav_OSBA_3OA_4ISM_bitrate_switching_13_2_to_512_32kHz_in_48kHz_out_EXT_out.dec.wav.2.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stvOSBA_4ISM_FOA48c.wav_OSBA_FOA_4ISM_at_256_kbps_48kHz_in_48kHz_out_EXT_out.dec.wav.0.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stvST48n.wav_2_ISM_with_metadata_at_32_kbps_48_kHz_in_48_kHz_out_DTX_on_EXTERNAL_out.dec.wav] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_JBM_dec.txt--stv20sOMASA_4ISM2TC.wav_OMASA_vdir2TC_4ISM_at_256_kbps_48kHz_in_48kHz_out_EXT_out_JBM_Prof_5.dec.wav.3.csv] - AssertionError: Output differs
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_JBM_dec.txt--stv4ISM48n.wav_4_ISm_with_metadata_at_64_kbps_48_kHz_in_48_kHz_out_DTX_on_EXT_out_JBM_Prof_0.dec.wav.0.csv] - AssertionError: Output differs

For the second batch, the reference files seemed to be missing (which I did not encounter in my runs on other platforms with the same set of reference files). These might be user error somehow, but not sure. Some of them were JBM and I remember some problem with those (involved people were @malenovskyvl and @norvell).

FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_JBM_dec.txt--stv20sOMASA_1ISM2TC.wav_OMASA_vdir2TC_1ISM_at_br_sw_techs_13_2_to_512_kbps_start_24_4_kbps_48kHz_in_48kHz_out_BINAURAL_ROOM_IR_out_JBM_Prof_5.dec.wav] - subprocess.CalledProcessError: Command '['C:\\Users\\knj\\Documents\\ivas-basop\\testvec_3a3a2ce7b84dee5b65e96301c38f19283bb2603d\\bin\\IVAS_dec', '-q', '-fr', '20', '-no_delay_cmp', '-Tracef...
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv51MC48c.wav_Multi_channel_5_1_at_32_kbps_48kHz_in_48kHz_out_BINAURAL_ROOM_REVERB_out_custom_acoustic_environment_with_a_sequence_ParamBin_.dec.wav] - subprocess.CalledProcessError: Command '['C:\\Users\\knj\\Documents\\ivas-basop\\testvec_3a3a2ce7b84dee5b65e96301c38f19283bb2603d\\bin\\IVAS_dec', '-q', '-fr', '20', '-render_config', './test...
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv51MC48c.wav_Multi_channel_5_1_at_64_kbps_48kHz_in_48kHz_out_BINAURAL_ROOM_REVERB_out_custom_acoustic_environment_with_a_sequence_FastConv_.dec.wav] - subprocess.CalledProcessError: Command '['C:\\Users\\knj\\Documents\\ivas-basop\\testvec_3a3a2ce7b84dee5b65e96301c38f19283bb2603d\\bin\\IVAS_dec', '-q', '-fr', '20', '-render_config', './test...
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stv4ISM48n.wav_4_ISM_with_and_without_extended_metadata_bitrate_switching_from_24_4_kbps_to_256_kbps_48_kHz_in_48_kHz_out_DTX_on_EXT_out.dec.wav.2.csv] - subprocess.CalledProcessError: Command '['C:\\Users\\knj\\Documents\\ivas-basop\\testvec_3a3a2ce7b84dee5b65e96301c38f19283bb2603d\\bin\\IVAS_dec', '-q', '-fr', '20', 'EXT', '48', './testv/ref...
FAILED conformance-test\test_26252.py::test_26252[Readme_IVAS_dec.txt--stvOSBA_4ISM_FOA48c.wav_OSBA_FOA_4ISM_at_br_sw_13_2_to_512_kbps_48kHz_in_16kHz_out_BINAURAL_out_Model_from_file_FER_at_5_bandwidth_switching.dec.wav] - subprocess.CalledProcessError: Command '['C:\\Users\\knj\\Documents\\ivas-basop\\testvec_3a3a2ce7b84dee5b65e96301c38f19283bb2603d\\bin\\IVAS_dec', '-q', '-fr', '20', '-hrtf', './binauralRende...

Ways to reproduce

Run BE conformance test for BASOP on windows.