-
Notifications
You must be signed in to change notification settings - Fork 102
[Feature] Add post training config for single view sample av models #60
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: yu chen <cy823236858@gmail.com>
cosmos_transfer1/diffusion/config/training/experiment/ctrl_7b_tp_sample_av.py
Outdated
Show resolved
Hide resolved
|
@caotians1 can we please trigger a pipeline according to instructions at [internal gitlab]/nvidia-cosmos/cosmos-transfer1? P1 we can also create a training test case, similar to [internal]/nvidia-cosmos/cosmos-predict1/-/blob/main/.gitlab/tests/tokenizer_post_training.sh |
cosmos_transfer1/diffusion/datasets/example_transfer_dataset.py
Outdated
Show resolved
Hide resolved
cosmos_transfer1/diffusion/datasets/example_transfer_dataset.py
Outdated
Show resolved
Hide resolved
cosmos_transfer1/diffusion/datasets/example_transfer_dataset.py
Outdated
Show resolved
Hide resolved
cosmos_transfer1/diffusion/datasets/augmentors/control_input.py
Outdated
Show resolved
Hide resolved
cosmos_transfer1/diffusion/datasets/augmentors/control_input.py
Outdated
Show resolved
Hide resolved
|
Please include a PR description. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thank you @caotians1!
Pipeline cosmos-transfer1/-/pipelines/27827082
…vidia-cosmos#60) * Add lidar & Hdmap feature to example dataloader Signed-off-by: yu chen <cy823236858@gmail.com> * hdmap/lidar ctrl posttrain config * ckpt loading fixes * fix input channel config to new convention * add short-video ctrlnet model, fix config for sample av post train * add 57 frame configs * adapt to new av-specific dataloader * add readme for postraining sample-av * fix typo * add back script * adapt to latest toolkit data format * resolve review items --------- Signed-off-by: yu chen <cy823236858@gmail.com> Co-authored-by: yu chen <cy823236858@gmail.com> Co-authored-by: Tianshi Cao <tianshic@nvidia.com>
Add post-training configs for transfer1-sample-AV [lidar] and [hdmap] with examples on Waymo dataset