Skip to content

Object pose estimation and also some pipeline enhancement #2397

Draft
Ruthie-FRC wants to merge 18 commits intoPhotonVision:mainfrom
Ruthie-FRC:object-pose-estimation
Draft

Object pose estimation and also some pipeline enhancement #2397
Ruthie-FRC wants to merge 18 commits intoPhotonVision:mainfrom
Ruthie-FRC:object-pose-estimation

Conversation

@Ruthie-FRC
Copy link
Contributor

Description

What changed? Why? (the code + comments should speak for itself on the "how")

Include fun testing screenshots or a cool video, to collect test evidence in a place where we can later reference it. Including proof this change was tested makes reviewing easier, helps us make sure we tested all our edge cases, and helps provide context for the future.

Any issues this pull request closes or pull requests this supersedes should be linked with Closes #issuenumber.

improved object detection pipeline configuration and processing. enhancements to 3D processing in the object detection pipeline, adjustments to default settings, and improvements to configuration options filtering.

closes #2284

Meta

Merge checklist:

  • Pull Request title is short, imperative summary of proposed changes
  • The description documents the what and why, including events that led to this PR
  • If this PR changes behavior or adds a feature, user documentation is updated
  • If this PR touches photon-serde, all messages have been regenerated and hashes have not changed unexpectedly
  • If this PR touches configuration, this is backwards compatible with all settings going back to the previous seasons's last release (seasons end after champs ends)
  • If this PR touches pipeline settings or anything related to data exchange, the frontend typing is updated
  • If this PR addresses a bug, a regression test for it is added
  • If this PR adds a dependency, the license has been checked for compatibility and steps taken to follow it

@github-actions github-actions bot added frontend Having to do with PhotonClient and its related items backend Things relating to photon-core and photon-server labels Mar 15, 2026
@Ruthie-FRC Ruthie-FRC marked this pull request as ready for review March 15, 2026 02:10
@Ruthie-FRC Ruthie-FRC requested a review from a team as a code owner March 15, 2026 02:10
@Ruthie-FRC
Copy link
Contributor Author

this is just a first attempt at it but figured I might as well get some feedback

@Ruthie-FRC Ruthie-FRC marked this pull request as draft March 15, 2026 02:16
@Ruthie-FRC Ruthie-FRC marked this pull request as ready for review March 15, 2026 02:57
InfiniteRechargeHighGoalOuter = 2,
CircularPowerCell7in = 3,
RapidReactCircularCargoBall = 4,
AprilTag6in_16h5 = 5,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why are these reordered?

cameraGain: 20,
targetModel: TargetModel.InfiniteRechargeHighGoalOuter,
ledMode: true,
targetModel: TargetModel.ReefscapeAlgae,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this changed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that.... that was me being an idiot and forgetting how things work. sorry.

Copy link
Contributor

@gerth2 gerth2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any screenshots or videos of this working? No testcases were updated

return List.of();
}

return detector.detect(in.getMat(), params.nms(), params.confidence());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why was this changed? there needs to be great caution with where mat's get returned, we've had memory leak issues from things like this in the past

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will revert.

@gerth2
Copy link
Contributor

gerth2 commented Mar 16, 2026

as a general note, this is a sizeable feature add. It should probably wait for a post-champs merge.

@Ruthie-FRC Ruthie-FRC marked this pull request as draft March 16, 2026 12:52
@Ruthie-FRC
Copy link
Contributor Author

Any screenshots or videos of this working? No testcases were updated
I need to test run it when i get to a proper laptop, i knew it wasnt ready for merge just wanted an idea of what egregious mistakes i should probably fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend Things relating to photon-core and photon-server frontend Having to do with PhotonClient and its related items

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add object pose estimation

2 participants