Skip to content

fix(ci): reduce hang dump size - #11405

Merged
ReubenBond merged 2 commits into
dotnet:mainfrom
ReubenBond:rb-fix-dynamodb-runner-loss
Oct 5, 2026
Merged

ReubenBond merged 2 commits into
dotnet:mainfrom
ReubenBond:rb-fix-dynamodb-runner-loss

Conversation

@ReubenBond

@ReubenBond ReubenBond commented Oct 4, 2026 •

Copy link
Copy Markdown
Member

Problem

Three unrelated CI partitions have stalled beyond the 10-minute inactivity threshold and then lost their hosted runner before the test step, cleanup, logs, or artifacts could complete:

Each test launch requested a Full hang dump. Full dumps include all process memory and mapped module images. On hosted runners, generating that diagnostic for an Orleans test host and its workload can amplify a stall into resource exhaustion, taking down the agent before diagnostics are uploaded.

Solution

Use Heap hang dumps for both ordinary and coverage test paths. Heap dumps retain modules, threads, stacks, handles, and managed memory needed to diagnose a stalled Orleans process while excluding mapped images. Keep Full crash dumps for actual process termination, where complete postmortem state remains the existing diagnostic policy.

Add workflow contract coverage which preserves hang-dump enablement, the 10-minute inactivity threshold, Heap capture on both launch paths, and Full crash diagnostics.

Rationale

This reduces hang-dump size without skipping tests, changing provider coverage, retrying hangs, or converting failures into success. A stalled partition still fails and retains managed state for analysis. The mitigation reduces one shared resource-pressure amplifier; #11331 remains open to correlate recurrence and obtain durable host-level evidence.

Mitigates #11331

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

Both launch paths apply the narrow diagnostic change consistently, with matching contract coverage and no blocking issues identified.

Review effort: Balanced
Findings: None

What changed in this PR

Reduces CI hang-dump size to help preserve hosted-runner availability and diagnostics.

Changes:

  • Uses Heap hang dumps for ordinary and coverage test runs.
  • Adds contract checks preserving hang diagnostics, the 10-minute timeout, and Full crash dumps.
File Description
.github/​scripts/​test-summarize-coverage.ps1 Adds dump-configuration contract checks.
.github/​actions/​dotnet-test/​action.yml Switches both hang-dump paths to Heap.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Copilot AI balanced review requested due to automatic review settings October 5, 2026 08:11
@ReubenBond ReubenBond changed the title fix(ci): bound hang dump collection fix(ci): reduce hang dump size Oct 5, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

The scoped change consistently updates both launch paths, preserves crash diagnostics, and has no identified blocking issues.

Review effort: Balanced
Findings: None

@ReubenBond
ReubenBond merged commit cad3ead into dotnet:main Oct 5, 2026
90 checks passed
@ReubenBond
ReubenBond deleted the rb-fix-dynamodb-runner-loss branch October 5, 2026 14:21
@github-actions github-actions Bot locked and limited conversation to collaborators Nov 5, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants