Skip to content

watch_regressions improvements

Context

Implement 2 features when watching regressions:

  • filter old benchmarks with the FIRST_DIR environment variable;
  • compare the latest run with a reference one using the REF_DIR environment variable.

Manually testing the MR

On 163.172.34.197, with a sudoer access, let's play the Cron script with Slack messages disabled, and as if the latest benchmarks run hasn't been treated:

sudo su redbull
cd /data/redbull/tezos
aws s3 ls s3://snoop-playground/mclaren/inference_csvs/snoop_results/ | grep PRE | tail -n 2 | head -n 1 | sed 's/ *PRE //' | sed 's,/$,,' > last_known_dir
eval $(opam env) && DISABLE_SLACK_MESSAGING=y FIRST_DIR=_snoop_20221118_2000_a5732235ef4e9820897a93ed8b9fcafb4fd44180 REF_DIR=_snoop_00_post-gas_for_M_based_on_20230110_2000_v15.0-rc1-2705-g1292297f9a /data/redbull/tezos/devtools/benchmarks-tools/watch_regressions.sh

Then, compare the alerts in file /data/redbull/tezos/alerts with the latest ones reported on Slack by the bot. They should be the same, except for a few cosmetic changes.

Checklist

  • Select suitable reviewers using the Reviewers field below.
  • Select as Assignee the next person who should take action on that MR
Edited by Nicolas Ayache

Merge request reports