Skip to content

Review Agent Failure Tracking #70231

Open
5 of 16 issues completed
Open

Description

@PureWeen

Tracks things the review-pull-request skill and Copilot Code Review (CCR) get wrong or miss, so we can see what to improve.

Workflow & How to Help

  1. Run the review skill: You can run the review-pull-request skill locally in Copilot CLI / VS Code, or trigger the hosted agent on any PR by commenting /review. @PureWeen is also running the skill locally across active PRs (applying agent-reviewed-approved / agent-reviewed-needs-changes labels) to compare against hosted /review and CCR, validate findings, and iterate on improvements.
  2. Report a bad finding or miss: If a review produces a false positive, wrong suggestion, or misses a real bug, let @PureWeen know, drop a comment on this issue, or ask Copilot to file a new sub-issue with #70231 as the parent epic.
  3. Or ask Copilot to diagnose and fix it directly using a prompt like:

    Evaluate why review-pull-request produced a bad finding (or missed an issue) on PR #<PR_NUMBER> (<COMMENT_LINK_OR_SUMMARY>). Trace whether the gap came from routed area guidance (docs/*.md / AGENTS.md), coordinator candidate packaging (.github/skills/review-pull-request/SKILL.md), or post-gate verification (.github/agents/review-candidate-verifier.agent.md), and update the relevant instructions, skill, or eng/skill-evals/review-pull-request/ evals with a general fix that doesn't overfit to this single PR.

Tracked Failure Modes

PRs Created to Improve Skills, Instructions & Evals

Activity

  1. self-assigned this
    on Nov 1, 2026
  2. added theissue type on Nov 1, 2026
  3. github-actions commented on Nov 1, 2026

    @github-actions
    Contributor

    Triage Summary

    Area: none assigned (the title and empty body do not identify an area with enough confidence)
    Type: Epic (preserved)

    Potential Duplicates

    • None found

    Generated by Issue Triage Agent for dotnet/aspnetcore for #70231 · copilot · auto · 12.9 AIC · ⌖ 1 AIC · ⊞ 7.3K · ◷

  4. added sub-issues on Nov 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions