Skip to content

[CI] Simplify and split long-term-regression plots

norvellrequested to merge
ci/fix-long-term-logs into main

Hi @kiene, @pihlajakuja,

I tried to simplify the long-term-regression plots. I added command line arguments for the --measure XX to use (MLD, MAX_ABS_DIFF) and a --days <int> argument to set a limit on the history.

The idea is to add this to the job ivas-long-term-job-logs-overview, and then both these html files would be linked from pages.

python3 ci/process_long_term_logs.py logs long_term_regression_MLD.html --measure MLD
python3 ci/process_long_term_logs.py logs long_term_regression_MAX_ABS_DIFF.html --measure MAX_ABS_DIFF

I ran the code locally after downloading the logs via the artifact: long_term_regression_MAX_ABS_DIFF.html long_term_regression_MLD.html

I am still not sure how helpful this is, since tracking the maximum is perhaps hiding other relevant cases. Also, the mean does not show very much at all. I tried with the min as we discussed, but it was practically flat all the time and just provided an anchor point more or less. It could be added without much effort.

Merge request reports