October
Flaky Tests: Quarantining
We’re excited to provide a new way for you to mitigate the negative impact of flaky tests in your repo through quarantining.
We’re excited to provide a new way for you to mitigate the negative impact of flaky tests in your
repo through quarantining.
Quarantining lets you isolate failures for known flaky tests so they don’t fail your CI jobs while
still continuing to run them. It looks for known flaky tests and determines which tests should be
isolated at runtime, avoiding the code changes usually required to disable flaky tests.
Running flaky tests without disabling them lets you validate your fixes by continuously monitoring
their results. This is especially important because
most attempted fixes for flaky tests don’t reduce the test’s flakiness.