add LeRobot ACT notebook #3111
add LeRobot ACT notebook #3111
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
Line #1. # Export ACT Model to ONNX
Can we skip this step, and convert it to OV IR directly ?https://docs.openvino.ai/2025/openvino-workflow/model-preparation/convert-model-pytorch.html
Reply via ReviewNB
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
I think we need an example to teach developer how to deploy this IR with OpenVINO
Reply via ReviewNB
|
|
||
| ENV_NAME="unitree_lerobot" | ||
| LEROBOT_DIR="unitree_IL_lerobot" | ||
| PY_VERSION="3.10" |
There was a problem hiding this comment.
Why should we limit the version of python and force developer to use Conda.
For user experience, a notebook should be run across different OS and python virtual environment.
| python -m pip install --upgrade pip wheel setuptools | ||
| } | ||
|
|
||
| install_openvino_requirements() { |
There was a problem hiding this comment.
please, add link to the quide https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/README.md#-installation-guide to the README instead of processing it here
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
Line #38. def pip_install(*packages):
we have such function in utils, please, check example in Prerequisites here https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/llm-native-agent-react/llm-native-agent-react.ipynb and use it
Reply via ReviewNB
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
Where model.safetensors are originally placed ? On which step and from where should we download it ?
Reply via ReviewNB
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
| @@ -0,0 +1,598 @@ | |||
| { | |||
There was a problem hiding this comment.
mo is deprecated, could you please convert model via ov.convert_model(model) https://docs.openvino.ai/2025/openvino-workflow/model-preparation/convert-model-pytorch.html ?
Reply via ReviewNB
3 participants
This PR adds a new tutorial notebook act_to_openvino.ipynb that demonstrates converting a Unitree Action Chunking Transformer (ACT) policy (from the LeRobot format) into OpenVINO IR (FP32). It walks through dependency verification, checkpoint preparation, ONNX export, OpenVINO Model Optimizer invocation, and artifact validation.
Conversion Flow
Core Dependencies: