TestApp/failed_with_one_good_asset_and_one_asset_not_json flaky test on windows runner

Summary

I've seen a couple of failures for this test case on Windows

Job #2315850110 failed for 5d05a691:

My guess is there is a race condition in the test