Commit 986c9515 authored by norvell's avatar norvell
Browse files

Updated test script

parent b3bcdefd
Loading
Loading
Loading
Loading
+6 −10
Original line number Diff line number Diff line
@@ -2,15 +2,11 @@
#
# BASOP verification helper script based on pytest framework
#
# 1) Make sure you have set up your environment, e.g. following the Linux runner setup https://forge.3gpp.org/rep/ivas-codec-pc/ivas-codec/-/wikis/Software-development/Setting-up-Linux-runner
# 2) Check out ivas-float-update in BASOP repo, compile and rename IVAS_{dec,rend} to IVAS_{dec,rend}_ref in the root folder of this working copy.
# 3) Check out main in BASOP repo, compile and copy IVAS_{dec,rend} to the root folder of this working copy.
# 4) Populate the "input" folder with input files (currently assuming 48 kHz sampling rate)
# 5) If needed, adjust configurations in tests/test_verification.py, e.g. setting supported output configurations according to 26.253 Table 4.4-1.
# 6) Run commands below
# 7) View results in report.csv, e.g. using Excel.
python3 -m pytest tests/test_verification.py --compare_to_input --dut_encoder_path evs_float/EVS_cod --dut_decoder_path evs_float/EVS_dec --odg --mld --ssnr --junit-xml=report-junit1.xml
python3 scripts/parse_xml_report.py report-junit1.xml report_float_enc_dec.csv --skip_formats

python3 -m pytest tests/test_verification.py --compare_to_input --dut_encoder_path evs_float/EVS_cod --dut_decoder_path evs_basop/EVS_dec --odg --mld --ssnr --junit-xml=report-junit2.xml
python3 scripts/parse_xml_report.py report-junit2.xml report_basop_dec.csv --skip_formats

python3 -m pytest tests/test_verification.py --update_ref 1; 
python3 -m pytest tests/test_verification.py --mld --ssnr --odg --junit-xml=report-junit.xml --dut_encoder_path ./IVAS_cod_ref
python3 scripts/parse_xml_report.py report-junit.xml report.csv
python3 -m pytest tests/test_verification.py --compare_to_input --dut_encoder_path evs_basop/EVS_cod --dut_decoder_path evs_float/EVS_dec --odg --mld --ssnr --junit-xml=report-junit3.xml
python3 scripts/parse_xml_report.py report-junit3.xml report_basop_enc.csv --skip_formats