Files
cozystack/hack
IvanHunters 51d02962ca test(e2e): add flake-vs-regression triage tool
A chainsaw case that fails on attempt 1 and passes on a re-run leaves the main
run green, so a case that has actually regressed reads as a flake and nobody
bisects it (cozystack/cozystack#3229 sat red on main for three consecutive
nightlies while treated as noise). hack/flake-triage.sh reads the failure set of
every attempt of the recent main runs (retry-to-green cannot mask a first-
attempt failure) and classifies each case: a failure streak across N consecutive
non-infra runs is a deterministic REGRESSION, an intermittent failure is a FLAKE,
and a whole-cluster outage run is excluded from the streak rather than counted.
The pure parse and classify halves are covered by hack/flake-triage_test.bats.

Signed-off-by: IvanHunters <xorokhotnikov@gmail.com>
2026-07-27 23:58:10 +03:00
..
2026-02-17 22:54:12 +01:00