Develop performance measurement build
We should have a CI pipeline that measures the performance metrics for the codec and publishes them.
Tasks
-
Create the necessary performance measurement job for CI -
Select/create test vectors for measurements and deploy to runners doing the measurements -
Publish data as minimum in pipeline artefacts but consider deploying them to Gitlab Pages - Extend complexity measurement: test more/other output formats with shorter testvectors to see changes in more modes
-
compare numbers between long and short testvectors to see the difference -
run more exhaustive test, e.g. by re-using the smoke test -
check runtime of current jobs, would more modes already fit in? Can we run the tests maybe bi-daily?
-
Edited by Jan Kiene