Skip to content

Develop performance measurement build

We should have a CI pipeline that measures the performance metrics for the codec and publishes them.

Tasks

  • Create the necessary performance measurement job for CI
  • Select/create test vectors for measurements and deploy to runners doing the measurements
  • Publish data as minimum in pipeline artefacts but consider deploying them to Gitlab Pages
  • Extend complexity measurement: test more/other output formats with shorter testvectors to see changes in more modes
    • compare numbers between long and short testvectors to see the difference
    • run more exhaustive test, e.g. by re-using the smoke test
    • check runtime of current jobs, would more modes already fit in? Can we run the tests maybe bi-daily?
Edited by Jan Kiene