-
Notifications
You must be signed in to change notification settings - Fork 2.4k
[rollout] feat: remove chat scheduler #2725
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[rollout] feat: remove chat scheduler #2725
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request removes the ChatCompletionScheduler and its related components. The changes are mostly subtractive and align with the goal of removing this feature, likely in favor of native tool support in inference engines or a new agent loop implementation.
My review has identified one high-severity issue: a test file for a function that is still in use has been removed, which impacts test coverage and future maintainability. Please see the specific comment for details.
|
LGTM |
|
Could we bump to 0.4.9+ at once? |
b4006a1 to
566b703
Compare
### What does this PR do? Remove chat scheduler as describe in volcengine#2618
* origin/mindspeed: (39 commits) [perf] feat: add optional role selection in discrete mode for NPU Profiler (volcengine#2750) [rollout] feat: remove chat scheduler (volcengine#2725) [trainer] refactor: Make sure to keep the type checking (volcengine#2634) [doc] style: change resize handle from gradient to plain color (volcengine#2746) [CI] feat: add `mypy` to pre-commit (volcengine#2614) [megatron] feat: a bunch of optimzation on vram, sequence packing (volcengine#2678) [docker] feat: upgrade to torch 2.7, sglang 0.4.8 (volcengine#2617) [doc] feat: add resizable sidebar and improve layout (volcengine#2577) [ci] fix: release ascend test time, fix one step off-policy CI (volcengine#2731) [recipe] chore: add retool training script (volcengine#2732) [ci] fix: checkpoint_convertor ci miss a hf model download (volcengine#2730) [doc] feat: Add agent-lightning in the list of "awesome works using verl (volcengine#2726) [tool] fix: geo3k create return str instead of tuple (volcengine#2714) [megatron] fix: resolve backward propagation error in megatron_actor due to shared logits tensor in-place modification (volcengine#2484) [misc] chore: bump main branch version to v0.5.0.dev (volcengine#2718) [sglang] fix: Adding strict naming sanity for sglang (volcengine#2719) [ray] feat: RayWorkerGroup support set worker env (volcengine#2685) [ci] test: add CriticWorker unit test, make some util CPU friendly (volcengine#2717) [cfg] refactor: add ActorConfig, EngineConfig, and ActorWorker unit test, refactor validation code (volcengine#2621) [misc] chore: bump version to v0.5.0 (volcengine#2716) ...
### What does this PR do? Remove chat scheduler as describe in volcengine#2618
### What does this PR do? Remove chat scheduler as describe in volcengine#2618
### What does this PR do? Remove chat scheduler as describe in volcengine#2618
### What does this PR do? Remove chat scheduler as describe in volcengine#2618
What does this PR do?
Remove chat scheduler as describe in #2618