Skip to content

FIX: surface failed suite entries behind cancellations - #4094

Open
Manohar Paturi (ManoharPaturi) wants to merge 1 commit into
microsoft:mainfrom
ManoharPaturi:fix/suite-cancel-hides-failures
Open

Manohar Paturi (ManoharPaturi) wants to merge 1 commit into
microsoft:mainfrom
ManoharPaturi:fix/suite-cancel-hides-failures

Conversation

@ManoharPaturi

Copy link
Copy Markdown
Contributor

Description

Fixes #4093

The suite execution aggregate status checked CANCELLED before FAILED, so cancelling an execution after a child run failed reported a clean CANCELLED and hid the failure from the suite summary. Polling clients keying alerts or restart decisions off the summary got no signal that work actually failed, even though the operator cancelled precisely because of that failure.

Failed work now outranks cancellation in the aggregate. Pure cancellations keep reporting CANCELLED, and the existing pins for the failed and cancelled suites are unchanged.

Tests and Documentation

Added a regression driving the aggregate with a FAILED and a CANCELLED entry and asserting FAILED, plus the pure cancellation case. It fails on main, which reports CANCELLED for the mixed set. The suite execution service suite passes at 11 tests and ruff is clean.

No documentation change needed, so I did not run JupyText.

The aggregate status checked CANCELLED before FAILED, so cancelling after a child run failed reported a clean cancellation and hid the failure from the suite summary. Failed work now outranks cancellation while pure cancellations keep reporting CANCELLED.

Signed-off-by: Manohar Paturi <186662190+ManoharPaturi@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings November 9, 2026 05:28

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Suite execution reports CANCELLED even when child runs failed

2 participants