Skip to content

Fixed point conversion of ism_dec and sub-funcs

Sandesh Venkatesh requested to merge ivas_ism_dec_fxd_conv into main

[x] Few funcs in ism_dec, mc_param_dec converted to fixed point.
[x] BASOP updates in few files.

Pytests: 573 failed, 381 skipped and 1 passed for original inputs, +10dB scaled and -10dB scaled inputs.

MLD:
Original: 4 cases > 5
8.622586 9.196089 12.944769 22.459263

+10dB: 16 cases > 5
5.35562 5.52244 5.663041 5.663041 6.294713 6.992652 9.476715 10.755767 10.755767 14.898742 16.605692 16.975687 23.385008 24.858898 27.042179 51.74955

-10dB: 3 cases > 5
8.665708 15.850357 24.996883

MLD deviation issue to be debugged.

Edited by Sandesh Venkatesh

Merge request reports