[BASOP CI] Detailed report summary
- Related issues: None
- Requested reviewers: @kiene
Reason why this change is needed
- Summarize daily test in histograms per format and operating mode (DTX, PLC, etc)
Description of the change
- The scripts/parse_xml_report.py is updated:
- Added identification of format and category (operating mode) from the test case name. This is added to the csv report in two new columns, so the preparation of the merged results with the diffs likely need to be adapted.
- Removed summary output from this script
- New script scripts/create_histogram_summary.py
- Generates a summary in csv format, and optionally a histogram of the mld values in an image file.
Example:
scripts/parse_xml_report.py report-junit.xml report.csv
scripts/create_histogram_summary.py --measure SSNR report.csv summary_SSNR.csv summary_SSNR.png
scripts/create_histogram_summary.py --measure DIFF report.csv summary_DIFF.csv summary_DIFF.png
scripts/create_histogram_summary.py --measure MLD report.csv summary_MLD.csv summary_MLD.png
report-junit.xml From pipeline https://forge.3gpp.org/rep/sa4/audio/ivas-basop/-/pipelines/35771, job https://forge.3gpp.org/rep/sa4/audio/ivas-basop/-/jobs/288783)
Affected operating points
- BASOP pages deployment
- Gitlab runner would need the matplotlib package
Edited by norvell