[non-BE] [allow-regression] Remove temporary input buffers in core-encoder Closes #2370 See merge request !2758