Move scale operations outside mul operations.