Frank oss try fix by frank-wei · Pull Request #14 · Hanchenli/vllm

frank-wei · 2025-10-15T21:06:29Z

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Boyuan Feng <[email protected]>

…ect#26873) Signed-off-by: sanghol <[email protected]>

…t backends (vllm-project#26656) Signed-off-by: MengqingCao <[email protected]>

…sts (vllm-project#26875) Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: angelayi <[email protected]>

…roject#26456) Signed-off-by: Yongye Zhu <[email protected]>

…llm-project#21810) Signed-off-by: Ye (Charlotte) Qi <[email protected]> Signed-off-by: zhewenli <[email protected]> Co-authored-by: Ye (Charlotte) Qi <[email protected]> Co-authored-by: Ye (Charlotte) Qi <[email protected]>

Signed-off-by: yewentao256 <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: youkaichao <[email protected]>

…sed by Flash Linear Attention ops. (vllm-project#26853) Co-authored-by: Xudong Ma <[email protected]>

…e in bailing_moe (vllm-project#26876) Signed-off-by: vito.yy <[email protected]>

…project#26842) Signed-off-by: Jialin Ouyang <[email protected]>

Signed-off-by: wangxiyuan <[email protected]>

…ect#26319) Signed-off-by: li2haipeng <[email protected]> Signed-off-by: Haipeng Li <[email protected]> Co-authored-by: Jee Jee Li <[email protected]>

vllm-project#25370) Signed-off-by: wang.yuqi <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: wangxiyuan <[email protected]>

Signed-off-by: Max Wittig <[email protected]>

Signed-off-by: Boyuan Feng <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Co-authored-by: Harry Mellor <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]>

…llm-project#26917) Signed-off-by: Harry Mellor <[email protected]>

Signed-off-by: Pradeep Dasigi <[email protected]>

…roject#26637) Signed-off-by: Samuel Wu <[email protected]> Signed-off-by: Sam/Samuel <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Co-authored-by: Harry Mellor <[email protected]>

Signed-off-by: XiaobingSuper <[email protected]>

Signed-off-by: Woosuk Kwon <[email protected]>

…26107) Signed-off-by: kaixih <[email protected]> Signed-off-by: mgoin <[email protected]> Co-authored-by: mgoin <[email protected]>

Signed-off-by: Wei Wei <[email protected]>

BoyuanFeng and others added 30 commits October 15, 2025 06:39

[Graph Partition] pass tests for decorator (vllm-project#26831)

f0862ea

Signed-off-by: Boyuan Feng <[email protected]>

[Bugfix][Multi Modal] Fix incorrect Molmo token processing (vllm-proj…

8865da1

…ect#26873) Signed-off-by: sanghol <[email protected]>

[DSA][MLA] Tiny refactor on DeepSeek to make it reusable for differen…

302ef40

…t backends (vllm-project#26656) Signed-off-by: MengqingCao <[email protected]>

[Misc] Use helper function to generate dummy messages in OpenAI MM te…

b8a4572

…sts (vllm-project#26875) Signed-off-by: DarkLight1337 <[email protected]>

[bugfix] Lazy import cv2 (vllm-project#26869)

efdef57

Signed-off-by: angelayi <[email protected]>

[Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (vllm-p…

f5ed68e

…roject#26456) Signed-off-by: Yongye Zhu <[email protected]>

[CI] Fix mypy for vllm/executor (vllm-project#26845)

71557a5

Signed-off-by: yewentao256 <[email protected]>

[Doc] ruff format remaining Python examples (vllm-project#26795)

6256697

Signed-off-by: DarkLight1337 <[email protected]>

[doc] add Context Parallel Deployment doc (vllm-project#26877)

650b51f

Signed-off-by: youkaichao <[email protected]>

[Misc] Update TritonLanguagePlaceholder to have attributes that are u…

5210dc3

…sed by Flash Linear Attention ops. (vllm-project#26853) Co-authored-by: Xudong Ma <[email protected]>

[Fix] Remove divisibility requirement between num_kv_heads and tp_siz…

5c3bae1

…e in bailing_moe (vllm-project#26876) Signed-off-by: vito.yy <[email protected]>

[Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (vllm-…

7f83b4e

…project#26842) Signed-off-by: Jialin Ouyang <[email protected]>

[Platform] allow platform to init dp group (vllm-project#22243)

db1764e

Signed-off-by: wangxiyuan <[email protected]>

[Lora]Load tuned multi-lora kernel configs from json files (vllm-proj…

d4d1a60

…ect#26319) Signed-off-by: li2haipeng <[email protected]> Signed-off-by: Haipeng Li <[email protected]> Co-authored-by: Jee Jee Li <[email protected]>

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (

f54f851

vllm-project#25370) Signed-off-by: wang.yuqi <[email protected]>

[Misc] Remove isort and yapf ignores (vllm-project#26888)

f93e348

Signed-off-by: DarkLight1337 <[email protected]>

[Misc] rename torch_dtype to dtype (vllm-project#26695)

8f4b313

Signed-off-by: wangxiyuan <[email protected]>

chore: remove unused marker (vllm-project#26890)

5d59868

Signed-off-by: Max Wittig <[email protected]>

[BugFix] Patch inductor memory plan logic (vllm-project#26878)

f574383

Signed-off-by: Boyuan Feng <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Co-authored-by: Harry Mellor <[email protected]>

[Chore] Separate out vllm.utils.func (vllm-project#26904)

136a17f

Signed-off-by: DarkLight1337 <[email protected]>

[Chore] Separate out vllm.utils.async_utils (vllm-project#26913)

828523a

Signed-off-by: DarkLight1337 <[email protected]>

Lower sevarity of log when model info cache misses due to exception (v…

d3cbaa0

…llm-project#26917) Signed-off-by: Harry Mellor <[email protected]>

Olmo 3 tool parser and tests (vllm-project#26143)

4794c2b

Signed-off-by: Pradeep Dasigi <[email protected]>

[Feature]: Use pydantic validation in observability.py config (vllm-p…

14f8456

…roject#26637) Signed-off-by: Samuel Wu <[email protected]> Signed-off-by: Sam/Samuel <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Co-authored-by: Harry Mellor <[email protected]>

[ModelOpt] Remove NVFP4 MoE K%16==0 constraint (vllm-project#26891)

d796375

Signed-off-by: XiaobingSuper <[email protected]>

[Chore] Clean up CODEOWNERS (vllm-project#26923)

a106362

Signed-off-by: Woosuk Kwon <[email protected]>

[NVIDIA] Add support for cudnn fp4 gemm via flashinfer (vllm-project#…

de92d91

…26107) Signed-off-by: kaixih <[email protected]> Signed-off-by: mgoin <[email protected]> Co-authored-by: mgoin <[email protected]>

merge main

7f36c11

Signed-off-by: Wei Wei <[email protected]>

fix the bug when StructuredOutputsParams is empty for constraints

07173f1

Signed-off-by: Wei Wei <[email protected]>

pre-commit

78642d0

Signed-off-by: Wei Wei <[email protected]>

frank-wei merged commit 90b5a70 into Hanchenli:lhc/oss-try Oct 15, 2025
4 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Frank oss try fix#14

Frank oss try fix#14
frank-wei merged 31 commits intoHanchenli:lhc/oss-tryfrom
frank-wei:frank_oss_try_fix

frank-wei commented Oct 15, 2025 •

edited by github-actions bot

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

frank-wei commented Oct 15, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

frank-wei commented Oct 15, 2025 •

edited by github-actions bot

Loading