Automated regression report on inferred gas models
Create and publish a report for each run that shows the difference (of inferred values) from some reference (could be the previous run or something fixed).
- Input: the
csv
files produced above, plus some reference ones or the ones produced at a previous run. - Output: a report of the differences between the inputs, stored on AWS.
- Steps:
-
save csv
files to AWS: !6786 (merged); -
develop a tool to make the diff of all csv
files: !6833 (merged). Tool is calledgas_parameter_diff
; -
deploy a cronjob on 163.172.34.197
that downloads thecsv
files from AWS and runsgas_parameter_diff
: https://gitlab.com/nomadic-labs/tezos/-/commits/rafoo@gas_regression_alerts.- This is kept as a branch for now (in opposition to a merge request), because it contains a patch to remove a newly added information: namespaces for gas parameters. The thing is that old benchmark runs don't enjoy this feature, but the
csv
s fed togas_parameter_diff
need to display the gas parameters consistently throughout all benchmark runs for the diff to work correctly. WhenM
is injected and we start working onN
, the patch will be removed and a merge request will be created from this branch.
- This is kept as a branch for now (in opposition to a merge request), because it contains a patch to remove a newly added information: namespaces for gas parameters. The thing is that old benchmark runs don't enjoy this feature, but the
-
Edited by Nicolas Ayache