feat: Add WebRTC streaming support #118
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This change introduces WebRTC streaming functionality to the record3d
application, allowing for an alternative to USB-based streaming.
Key changes include:
- Integrated `libdatachannel` as the WebRTC C++ library.
- Implemented a `WebRTCSignaling` class to manage WebRTC connection
establishment (SDP, ICE) and data channel communication.
- Extended the `Record3DStream` class:
- Added `ConnectToDeviceViaWebRTC` to initiate WebRTC connections.
- Implemented frame data processing for frames received over WebRTC,
reusing existing decompression and decoding logic.
- Exposed WebRTC signaling mechanisms (callbacks for local SDP/ICE,
methods to submit remote SDP/ICE) to allow for flexible signaling
implementations.
- Updated Python bindings:
- Exposed `ConnectToDeviceViaWebRTC`.
- Exposed WebRTC signaling callbacks and methods to Python.
- Created `webrtc-demo.py`:
- A Python script demonstrating how to use the new WebRTC functionality.
- Includes example WebSocket-based signaling logic and OpenCV for
frame display.
- Added C++ unit tests:
- Cover WebRTC connection initiation.
- Test SDP/ICE exchange pathways.
- Verify frame data processing for data received over WebRTC.
The system now supports connecting to and streaming from devices using
WebRTC, with Python scripts able to manage the signaling process.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This change introduces WebRTC streaming functionality to the record3d application, allowing for an alternative to USB-based streaming.
Key changes include:
libdatachannelas the WebRTC C++ library.WebRTCSignalingclass to manage WebRTC connection establishment (SDP, ICE) and data channel communication.Record3DStreamclass:ConnectToDeviceViaWebRTCto initiate WebRTC connections.ConnectToDeviceViaWebRTC.webrtc-demo.py:The system now supports connecting to and streaming from devices using WebRTC, with Python scripts able to manage the signaling process.