Merge branch 'main' into 120-incorrect-naming-of-ism-metadata-files (8c7a985a) · Commits · IVAS Codec Public Collaboration / IVAS Processing Scripts

README.md

+40 −1

Original line number	Diff line number	Diff line
		@@ -104,10 +104,42 @@ for %f in (experiments\characterization\P800-1\config\*.yml) do python -m ivas_p

		After the processing is finished, the outputs will be present in the respective `proc_output` directories.

		### Item collection

		- For P.800 tests, these outputs need to be collected according to the test plan to assemble the final outputs required for P.800 test software.

		- This can be done using the scripts in [collection-scripts](collection-scripts/characterization/README.md) (click for README) by running:

		```batch
		python collection-scripts\characterization\p800_categorized_samples.py
		python collection-scripts\characterization\p800_preliminaries.py
		```

		- For MUSHRA tests, the outputs may be used directly, or in case of multi-input format experiments again need to be manually assembled.

		At this point of time there is no script to automatically perform this.
		### Hash generation

		The hashes for the `proc_final` (or `proc_output` for BS.1534 experiments) can be generated using the [get_md5.py](other/get_md5.py) script:

		```shell
		> python other/get_md5.py --help
		usage: get_md5.py [-h] output_dir out_file

		Cross-platform script for generating MD5 hashes of output files for the characterization testing experiments.

		positional arguments:
		output_dir Path to the output directory of the respective experiment that you want to generate Hashes for. Can be proc_output or proc_final.
		out_file Output text file with filenames and Hashes

		options:
		-h, --help show this help message and exit
		```

		For example:

		```shell
		python other/get_md5.py experiments/characterization/P800-1/proc_final p800-1_hashes.txt
		```

		## Directory structure

		@@ -127,6 +159,13 @@ At this point of time there is no script to automatically perform this.
		│ │ └── <item_name.wav.met> for MASA metadata
		│ ├── cat2...
		│ └── ...cat6
		├── proc_final
		│ ├── c01
		│ │ └── [l]p[ee]a[y]s[zz].c[nn].wav
		│ ├── c02...
		│ ├── ...c36
		│ └── preliminaries
		│ └── [l]p[ee]a[y]s[zz].c[nn].wav
		└── proc_output
		├── cat1
		│ ├── out_-16LKFS

experiments/characterization/P800_ACR-1/background_noise/.gitkeep

0 → 100644

+0 −0

Empty file added.

experiments/characterization/P800_ACR-1/config/P800_ACR-1_cat1_STEREO-26LKFS.yml

0 → 100644

+674 −0

Original line number	Diff line number	Diff line
		---
		# test plan based on S4aA250068 v0.8.0

		################################################
		# General configuration
		################################################

		name: P800_ACR-1
		master_seed: 25
		prerun_seed: 2

		input_path: "experiments/characterization/P800_ACR-1/proc_input/cat1"
		output_path: "experiments/characterization/P800_ACR-1/proc_output/cat1/out_-26LKFS"
		use_windows_codec_binaries: false
		condition_in_output_filename: true

		################################################
		### Input configuration
		################################################
		input:
		fmt: "STEREO"
		fs: 48000
		aligned_to:
		len: 20

		################################################
		### Pre-processing on individual items
		################################################
		preprocessing:
		mask: "20KBP"
		loudness: -26
		window: 100

		################################################
		### Pre-processing on whole signal(s)
		################################################
		preprocessing_2:
		concatenate_input: true
		preamble_noise: true
		preamble: 10000
		repeat_signal: true

		################################################
		### Configuration for conditions under test
		################################################
		conditions_to_generate:
		### Reference and Low-pass anchor conditions ###
		c01:
		type: ref
		c02:
		type: ref
		out_fc: 16000
		c03:
		type: ref
		out_fc: 14000
		c04:
		type: ref
		out_fc: 12000
		c05:
		type: ref
		out_fc: 10000
		c06:
		type: ref
		out_fc: 8000
		c07:
		type: ref
		out_fc: 6000
		c08:
		type: ref
		out_fc: 4000
		### MNRU conditions ###
		c09:
		type: mnru
		q: 30
		c10:
		type: mnru
		q: 26
		c11:
		type: mnru
		q: 22
		c12:
		type: mnru
		q: 18
		### ESDRU conditions ###
		c13:
		type: esdru
		alpha: 0.8
		c14:
		type: esdru
		alpha: 0.6
		c15:
		type: esdru
		alpha: 0.4
		c16:
		type: esdru
		alpha: 0.2
		### IVAS WB conditions ###
		c17:
		type: ivas
		bitrates:
		- 13200
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c18:
		type: ivas
		bitrates:
		- 16400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c19:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c20:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c21:
		type: ivas
		bitrates:
		- 48000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c22:
		type: ivas
		bitrates:
		- 64000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c23:
		type: ivas
		bitrates:
		- 80000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c24:
		type: ivas
		bitrates:
		- 96000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		### IVAS SWB conditions ###
		c25:
		type: ivas
		bitrates:
		- 13200
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c26:
		type: ivas
		bitrates:
		- 16400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c27:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c28:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c29:
		type: ivas
		bitrates:
		- 48000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c30:
		type: ivas
		bitrates:
		- 64000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c31:
		type: ivas
		bitrates:
		- 80000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c32:
		type: ivas
		bitrates:
		- 96000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c33:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c34:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c35:
		type: ivas
		bitrates:
		- 48000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c36:
		type: ivas
		bitrates:
		- 64000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c37:
		type: ivas
		bitrates:
		- 80000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c38:
		type: ivas
		bitrates:
		- 96000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c39:
		type: ivas
		bitrates:
		- 128000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c40:
		type: ivas
		bitrates:
		- 160000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c41:
		type: ivas
		bitrates:
		- 192000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c42:
		type: ivas
		bitrates:
		- 256000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		#################
		## DTX conditions
		#################
		c43:
		type: ivas
		bitrates:
		- 13200
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -dtx
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c44:
		type: ivas
		bitrates:
		- 16400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -dtx
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c45:
		type: ivas
		bitrates:
		- 16400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -dtx
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c46:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -dtx
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c47:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -dtx
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		c48:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -dtx
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		#################
		## FER conditions
		#################
		c49:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c50:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c51:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c52:
		type: ivas
		bitrates:
		- 48000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c53:
		type: ivas
		bitrates:
		- 64000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c54:
		type: ivas
		bitrates:
		- 80000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		##########################
		## DTX with FER conditions
		##########################
		c55:
		type: ivas
		bitrates:
		- 16400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -dtx
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c56:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 16000
		opts:
		- -dtx
		- -max_band
		- WB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c57:
		type: ivas
		bitrates:
		- 24400
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -dtx
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c58:
		type: ivas
		bitrates:
		- 32000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		fs: 32000
		opts:
		- -dtx
		- -max_band
		- SWB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c59:
		type: ivas
		bitrates:
		- 48000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -dtx
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		c60:
		type: ivas
		bitrates:
		- 64000
		cod:
		bin: ivas_processing_scripts/bin/IVAS_cod_fx
		opts:
		- -dtx
		- -max_band
		- FB
		dec:
		bin: ivas_processing_scripts/bin/IVAS_dec_fx
		tx:
		type: FER
		error_rate: 5
		################################################
		### Post-processing
		################################################
		postprocessing:
		fmt: "STEREO"
		fs: 48000
		loudness: -26

experiments/characterization/P800_ACR-1/config/P800_ACR-1_cat2_FOA-26LKFS.yml

0 → 100644

+605 −0

File added.

Preview size limit exceeded, changes collapsed.

experiments/characterization/P800_ACR-1/config/P800_ACR-1_cat3_HOA3-26LKFS.yml

0 → 100644

+606 −0

File added.

Preview size limit exceeded, changes collapsed.