Sourcing and configuring machines for centralized benchmarking.
Context
Currently we have one benchmarking machine for formal benchmarking tests and another for benchmarking development. Given new requirements for buildstream MR benchmarking it would be preferable to have multiple machines (with the same comparable spec) to carry out tests since this could significantly increase the loading on benchmarking.
Multiple machines should therefore be sourced (with the same comparable spec) to increase capacity.
As part of this process the orchestration of benchmarking jobs will need to take into consideration multiple machines and provide checking mechanisms to ensure comparable performance and demarcate between runs on different machines.
- Relevant Log / Screenshot
Task Description
-
Create script work/flow to configure machines -
Source multiple machines to achieve above. -
Enhance orchestration techniques to take into account multiple benchmarking machines and performance factors.
Acceptance Criteria
Satisfy requirements provided in context.