Snoop: benchmarks are executed with a fixed random seed
perform_benchmarks.ml has ~seed:87612786
: the benchmarks are executed always with a fixed random seed.
MR !10160 (merged) records the used seed in the workload files. Once it is merged we should think of removing this fixed seed.
Changing the seed for each run may reveal unknown instability of benchmarks.
Edited by Jun Furuse