Skip to content

Draft: DO NOT MERGE Resolve "IVAS decoder extension: socket communication for pose input and audio output"

Devansh Kandpalrequested to merge
1993-ivas-dec-socket-communication into main

Basic info

Refers to #1993.

This merge request introduces IVAS decoder extension supporting socket communication for pose input and audio output.

This feature is currently only applicable for Windows.

Usage

IVAS decoder command line is extended with a -socket <port> option, where <port> is a TCP/IP port number from the range of dynamic, private or ephemeral ports (49152-65535). This allows for inter-process communication between IVAS and controlling application (e.g., a listening test tool or a demo application) running on the same machine. Once invoked with this option, IVAS decoder awaits a TCP message containing a string starting with IVAS buffer request followed by listener pose data in quaternion format (w, x, y, z). Eventually, a following frame is decoded and sent back through a TCP message containing raw binaural audio data buffer.

An application communicating with IVAS decoder shall send an IVAS buffer reqest message for every frame of 20ms. This should be done in combination with audio I/O buffer management specific for the application OS.

Merge request reports