Overflow in preprocessing
Basic info
- Fixed point:
- Encoder (fixed): 20cb1008
Bug description
In the preprocessing, some parameters are deviating from float because of overflow. The next figure shows an example for lps
From top to bottom:
- Input file
- lps from floating point code
- lps from fixed point code
- Diff between float and fix
Ways to reproduce
ivas_cod -STEREO 2 32000 48 ltv48s.wav bit