Skip to content

Add composite pipeline for tags and object detection#2351

Open
halfaleague wants to merge 2 commits intoPhotonVision:mainfrom
halfaleague:composite-april-object-pipeline
Open

Add composite pipeline for tags and object detection#2351
halfaleague wants to merge 2 commits intoPhotonVision:mainfrom
halfaleague:composite-april-object-pipeline

Conversation

@halfaleague
Copy link

Description

PhotonVision pipelines currently run a single primary operation at a time (e.g., AprilTags or object detection), which prevents concurrent tag + object use on the same
camera stream. This PR adds a composite pipeline that runs both on the same frame, publishes combined results plus separate tag/object NetworkTables outputs, and draws both
overlays in the output stream. UI and frontend typing are updated to expose the composite pipeline and per-op enable toggles. This is additive and does not change existing
pipeline behavior.

Testing + evidence:

  • Built ARM64 jar: ./gradlew :photon-server:shadowJar -PArchOverride=linuxarm64 -Ponlylinuxarm64
  • Deployed to Orange Pi; service running
  • Evidence: attach screenshot/video of composite pipeline running (UI + overlay)
Screenshot from 2026-02-03 19-10-33

@halfaleague halfaleague requested a review from a team as a code owner February 4, 2026 00:12
@github-actions github-actions bot added frontend Having to do with PhotonClient and its related items backend Things relating to photon-core and photon-server labels Feb 4, 2026
@halfaleague
Copy link
Author

Thoughts? Is this in the right direction?

@samfreund
Copy link
Member

Thoughts? Is this in the right direction?

Looks promising! I don't have the time to review rn, but I'll try and make that happen sometime tonight. It would be great if you could update your branch so it's up to date with main too.

@mcm001
Copy link
Contributor

mcm001 commented Feb 4, 2026

I think that #2262 is the better direction of the two approaches personally

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend Things relating to photon-core and photon-server frontend Having to do with PhotonClient and its related items

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants