472 Sub Plan Execution
- Improved naming of flags
- Added ISessionFlag interface.
- Added performance improvement in test plan, so that component settings without any metadata are not automatically instanciated
- Added log forwarding to test plan reference, which removes test plan log messages.
- Added unit test, testing running test plan reference steps in parallel.
- Added support for component settings sessions.
- Result proxying
- Log proxying
- re-use resources
Performance:
These performance tests was done by running:time bin/Release/tap.exe profile --quiet [profile case] and measure real-time.
| Profile Case | After | Before | Comment |
|---|---|---|---|
| --test-plan | 0m50.649s | 0m50.858s | Same |
| --short-test-plan | 0m6.210 | 0m6.312s | Same |
| --short-test-plan --run-async | 0m8.694 | 0m7.708s | Better async test plan execution. |
| --run-long-plan | 1m17.879s | 1m18.265 | Same |
| --run-long-plan-with-references | 0m32.010 | 0m33.011s | Same |
| --run-long-plan-with-references --hide-steps | N/A | 10m16.184s | Slower due to running in 'overlay' mode. |
| --parameterize | 0m1.345 | 0m1.350s | Same |
| --logging | 0m1.096s | 0m1.162s | 50-70ms (~5%) slower |
Closes #472 (closed), #563 (closed)
Edited by Rolf Madsen