Skip to content

chore(0.16.0-support): bump vllm to v0.16.0#778

Merged
tjohnson31415 merged 8 commits intomainfrom
0.16.0-support
Mar 2, 2026
Merged

chore(0.16.0-support): bump vllm to v0.16.0#778
tjohnson31415 merged 8 commits intomainfrom
0.16.0-support

Conversation

@prashantgupta24
Copy link
Copy Markdown
Collaborator

@prashantgupta24 prashantgupta24 commented Feb 27, 2026 •
edited by tjohnson31415
Loading

Description

Bump to vLLM v0.16.0 without backwards compatibility (2.0 is still pre-release)

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Feb 27, 2026

👋 Hi! Thank you for contributing to vLLM support on Spyre.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, run ./format.sh.
Now you are good to go 🚀.

We also recommend installing prek and configuring it to check your code before every local commit.

@prashantgupta24
Copy link
Copy Markdown
Collaborator Author

prashantgupta24 commented Feb 27, 2026

bot:test

@prashantgupta24 prashantgupta24 changed the title chore(0.16.0-support): bump vllm upper bound to v0.16.0 chore(0.16.0-support): bump vllm to v0.16.0 Feb 28, 2026
@prashantgupta24
test(0.16.0-support): update validate_request calls with processed_in…
6922133 
…puts=None

Since we had to remove the | None from the function definition to adhere to upstream definition

Signed-off-by: Prashant Gupta <[email protected]>
@prashantgupta24
Copy link
Copy Markdown
Collaborator Author

prashantgupta24 commented Feb 28, 2026

bot:test

@joerunde joerunde mentioned this pull request Mar 2, 2026
Closed
1 task
@tjohnson31415
Copy link
Copy Markdown
Collaborator

tjohnson31415 commented Mar 2, 2026

I was able to test and confirm working the changes around using the profiler. Tested by passing --profiler-config '{"profiler": "torch", "torch_profiler_dir": "./vllm_profile"}' to vllm serve. Worked both with and without the AIU Kineto tracing. In that testing, I saw some logging improvements to be made, so pushed those too (eg. adjusting the log order now that we use the wrapper).

joerunde
joerunde approved these changes Mar 2, 2026
View reviewed changes
Copy link
Copy Markdown
Collaborator

@joerunde joerunde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lpgtm

@tjohnson31415 tjohnson31415 mentioned this pull request Mar 2, 2026
Open
1 task
@tjohnson31415 tjohnson31415 marked this pull request as ready for review March 2, 2026 21:40
@tjohnson31415
Copy link
Copy Markdown
Collaborator

tjohnson31415 commented Mar 2, 2026

The spyre-ci test that was failing in bot:test was fixed in:
#785

@tjohnson31415 tjohnson31415 merged commit 4b5c9bd into main Mar 2, 2026
12 checks passed
@tjohnson31415 tjohnson31415 deleted the 0.16.0-support branch March 2, 2026 21:51
@tjohnson31415 tjohnson31415 mentioned this pull request Mar 3, 2026
Merged
tjohnson31415 added a commit that referenced this pull request Mar 4, 2026
@tjohnson31415
chore: Add support for vllm 0.16.0 (#790)
2742560 
## Description

Support for vllm 0.16.0 with full backwards compatibility for the 1.x
release line.

PR for 0.16.0 to main:
#778

## Test Plan

CI tests should all pass

---------

Signed-off-by: Travis Johnson <[email protected]>
romitjain pushed a commit to romitjain/vllm-spyre that referenced this pull request Mar 16, 2026
@prashantgupta24 @tjohnson31415 @romitjain
chore(0.16.0-support): bump vllm to v0.16.0 (torch-spyre#778)
cedd824 
## Description

Bump to vLLM v0.16.0 without backwards compatibility (2.0 is still
pre-release)

---------

Signed-off-by: Prashant Gupta <[email protected]>
Signed-off-by: Travis Johnson <[email protected]>
Co-authored-by: Travis Johnson <[email protected]>
Signed-off-by: romit <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joerunde joerunde joerunde approved these changes

@rafvasq rafvasq Awaiting requested review from rafvasq rafvasq is a code owner

@sducouedic sducouedic Awaiting requested review from sducouedic sducouedic is a code owner

@yannicks1 yannicks1 Awaiting requested review from yannicks1

@tdoublep tdoublep Awaiting requested review from tdoublep

@nikolaospapandreou nikolaospapandreou Awaiting requested review from nikolaospapandreou

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@prashantgupta24 @tjohnson31415 @joerunde