Skip to content

[BASOP CI] Detailed report summary

norvell requested to merge basop-ci/detailed-report-summary into main
  • Related issues: None
  • Requested reviewers: @kiene

Reason why this change is needed

  • Summarize daily test in histograms per format and operating mode (DTX, PLC, etc)

Description of the change

  • The scripts/parse_xml_report.py is updated:
    • Added identification of format and category (operating mode) from the test case name. This is added to the csv report in two new columns, so the preparation of the merged results with the diffs likely need to be adapted.
    • Removed summary output from this script
  • New script scripts/create_histogram_summary.py
    • Generates a summary in csv format, and optionally a histogram of the mld values in an image file.

Example:

scripts/parse_xml_report.py report-junit.xml report.csv
scripts/create_histogram_summary.py --measure SSNR report.csv summary_SSNR.csv summary_SSNR.png 
scripts/create_histogram_summary.py --measure DIFF report.csv summary_DIFF.csv summary_DIFF.png 
scripts/create_histogram_summary.py --measure MLD report.csv summary_MLD.csv summary_MLD.png 

report-junit.xml From pipeline https://forge.3gpp.org/rep/sa4/audio/ivas-basop/-/pipelines/35771, job https://forge.3gpp.org/rep/sa4/audio/ivas-basop/-/jobs/288783)

report.csv

summary.csv

Affected operating points

  • BASOP pages deployment
  • Gitlab runner would need the matplotlib package
Edited by norvell

Merge request reports

Loading