-
-
Notifications
You must be signed in to change notification settings - Fork 11.7k
Remove deprecated fields from CompilationConfig
#27593
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove deprecated fields from CompilationConfig
#27593
Conversation
Signed-off-by: Harry Mellor <[email protected]>
|
Documentation preview: https://vllm--27593.org.readthedocs.build/en/27593/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request removes the deprecated use_cudagraph and full_cuda_graph fields from the CompilationConfig and updates the config tests accordingly. The removal of these flags simplifies the configuration and aligns with the deprecation schedule. The test updates ensure the config tests are passing.
Signed-off-by: Harry Mellor <[email protected]>
fhl2000
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thanks for doing the deprecations!
simon-mo
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
stamp
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
|
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: George D. Torres <[email protected]>
Signed-off-by: Harry Mellor <[email protected]> (cherry picked from commit a742134)
Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Bram Wasti <[email protected]>
Signed-off-by: Harry Mellor <[email protected]>
use_cudagraphandfull_cuda_graphhave been deprecated since [Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer #20059v0.11.0, which has already been released