abort-current-inline-script behaves ineffectively
Environment
- CI/CD pipeline from adblockpluschrome
- Manual testing: Chrome Version 79.0.3945.88 (Official Build) (64-bit) on MacOS. Extension: Version number 3.8.0.2475
How to reproduce
Automated testing
- Run adblockpluschrome test pipeline
- Run the test locally:
npm run test-only -- -g 'Chromium \(oldest\).*abort'
Manual testing
- Load https://testpages.adblockplus.org/en/snippets/abort-current-inline-script
- Enable the first filter
- Reload the page
- Keep reloading the page quickly (cmd+R)
Observed behavior
Automated testing
abort-current-inline-script test fails (flaky):
1) Chromium (oldest)
Test pages
Filter test cases
abort-current-inline-script:
Error: Screenshots don't match
Test case: Basic usage
https://testpages.adblockplus.org/en/snippets/abort-current-inline-script
(see chromium_oldest_abort_current_inline_script_basic_usage_*.png in test/screenshots)
at runGenericTests (test/suites/pages/index.js:196:11)
Manual testing
After some reloads the test fails, which means that the snippet is not effective anymore
Expected behavior
Both automated and manual tests should not fail.