Improve test framework for test isolation to scale test parallelization and stability

Problem Statement

Our current test suite lacks proper isolation between individual tests, which limits our ability to effectively parallelize test execution. This leads to longer build times, increased resource usage, and potential flakiness in our CI/CD pipeline.

Expected Benefits

• Faster CI/CD pipeline execution
• Improved resource utilization
• Reduced flakiness in test results
• Better scalability of our test infrastructure
• Easier maintenance and debugging of individual tests

Discussion Threads

• Root Cause
• Action Items

Plan

TBD based on discussions