Fix for crash issues observered for SBA format with LTV set

LTV crash for below cases are fixed:
[SBA at 24.4 kbps, 32kHz in, 32kHz out, STEREO out]
[SBA at 32 kbps, 48kHz in, 48kHz out, MONO out, DTX, bandwidth switching]