-
-
Notifications
You must be signed in to change notification settings - Fork 11.7k
Fix missing data type in flashinfer prefill #10141
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
👋 Hi! Thank you for contributing to the vLLM project. Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can do one of these:
🚀 |
ea73f6c to
09064d4
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
L366-368 are changed by format.sh when I run it locally.
09064d4 to
697d9d1
Compare
Signed-off-by: Yang Yu <[email protected]>
697d9d1 to
6d28546
Compare
|
Could you provide some more context about the bug? |
|
This pull request has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this pull request should remain open. Thank you! |
|
This pull request has merge conflicts that must be resolved before it can be |
|
This pull request has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this pull request should remain open. Thank you! |
Fix flashinfer prefill.plan bug.
It is similar to PR #8173, but in #8173 , the prefill code is not modified.
cc @pavanimajety @yzh119 @comaniac