Add logging to tests and scripts to breakdown and analyze logs from benchmarking results
Description
One requirement that has been outlined is the extraction of performance data from buildstreams. This requires a configuration of buildstream, extraction of the logfile results and scripts to chew down entries to extract "per element" information.
Changes proposed in this merge request:
- Addition of logfile configuration (time format in user config), definition (place where it is to be stored), addition to measurements
- Addition of logging options to tests
- Addition of new tests to exploit and evaluate logging results (bstgen)
- As part of using bstgen - clone benchmarking repo and install into docker container instances.
- Recover jmac's logfile analyser work and modify to work with string buffers extracted from benchmarking results.
- Modify logfile analyser work so that calls con made made from other orchestrating scripts.
- Correct logfile analyser work as required.
- Add proper tree construction into analyser so that the "per element" leaf node results can be evaluated in isolation.
- Add functionality to compare and evaluate two build results trees so that the differences can evaluated.
- Add orchestrating scripts to handle multiple files and evaluate results on a "per test type" basis.
- Retrofit logging approach into existing benchmarking tests as required.