Start builds from failure point to reduce test time.
@stanhu and I were talking and we would like to have the CI optionally work like this:
- Run your CI tests as usual.
- Test fails.
- Next time you run your tests, start from that point forward.
- Continue this pattern until the whole thing passes.
- Once the whole thing passes run the whole test suite again.
This is in contrast to the way it currently works which is rerun the whole test every time.
This method could save a ton of time. Our tests currently take at least 80 minutes to run. We could cut that 80 minutes down.
No one at this point wants to run tests on our CI for fear of time and sanity loss.
You need everything to pass but developers don't run everything every time. We run whatever failed. So why shouldn't we duplicate our local methods remotely.