Precision improvements in mdct core enc