CI: Set flaky [evm], [sc_rollup] tests as flaky
Context
Builds on !11174 (merged).
Adds the tag Ci.flaky to the tests below. The consequence of this
(after !11174 (merged) ) is that they are not executed in normal
before_merging pipelines, but are instead executed in scheduled pipelines with
a higher retry count:
Alpha: arith - garbage collection is triggered and finishes correctly (full) (many_gc)
Alpha: arith - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Alpha: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (many_gc)
Alpha: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Nairobi->Alpha: wasm_2_0_0 - refutation games over migrations (inbox_proof_1_at_published_commitment)
Nairobi->Alpha: wasm_2_0_0 - refutation games over migrations (pvm_proof_2_at_inbox)
Nairobi->Alpha: wasm_2_0_0 - refutation games over migrations (pvm_proof_2_at_published_commitment)
Nairobi: arith - garbage collection is triggered and finishes correctly (full) (many_gc)
Nairobi: arith - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Nairobi->Oxford: wasm_2_0_0 - refutation games over migrations (inbox_proof_1_at_published_commitment)
Nairobi->Oxford: wasm_2_0_0 - refutation games over migrations (pvm_proof_2_at_inbox)
Nairobi->Oxford: wasm_2_0_0 - refutation games over migrations (pvm_proof_2_at_published_commitment)
Nairobi: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (many_gc)
Nairobi: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Oxford: arith - garbage collection is triggered and finishes correctly (full) (many_gc)
Oxford: arith - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Oxford: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (many_gc)
Oxford: wasm_2_0_0 - garbage collection is triggered and finishes correctly (full) (sparse_gc)
Manually testing the MR
Check that the list of new tests with the tag flaky are as specified above:
comm -1 -3 <(cd ../master; tezt_ --list-tsv flaky | grep -v qcheck | csvcut -t -c 2 | sort) <(tezt_ --list-tsv flaky | grep -v qcheck | csvcut -t -c 2 | sort)
with alias tezt_=_build/default/tezt/tests/main.exe.
Checklist
-
Document the interface of any function added or modified (see the coding guidelines) -
Document any change to the user interface, including configuration parameters (see node configuration) -
Provide automatic testing (see the testing guide). -
For new features and bug fixes, add an item in the appropriate changelog ( docs/protocols/alpha.rstfor the protocol and the environment,CHANGES.rstat the root of the repository for everything else). -
Select suitable reviewers using the Reviewersfield below. -
Select as Assigneethe next person who should take action on that MR
Edited by Arvid Jakobsson