Skip to content

support PCP #25852

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 31 commits into from
Closed

support PCP #25852

wants to merge 31 commits into from

Conversation

@LookAround0301
Copy link
Contributor

@LookAround0301 LookAround0301 commented Sep 29, 2025 •
edited by github-actions bot
Loading

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

@mergify mergify bot added the v1 label Sep 29, 2025
LookAround0301 and others added 13 commits September 29, 2025 21:27
@LookAround0301
[bug fix] fix block size bug
ccb6239 
Signed-off-by: LookAround <[email protected]>
@FENP
flashinfer backend support context parallel — decode phase
f064d1a
@FENP
flashinfer backend support context parallel — prefill phase
f649ffd
@pisceskkk @FENP
flashinfer backend support context parallel — custom mask and kv reorg
d604ae3
@FENP
add context_parallel_size to ensure_model_parallel_initialized
c0bbb52
@FENP
bug fix: only update decode seq_lens
3f418de
@pisceskkk @FENP
bug fix: update custom mask calc
817bc28
@LookAround0301 @FENP
[scheduler] support cp
3add9a3 
Signed-off-by: LookAround <[email protected]>
@LookAround0301 @FENP
[bug fix] fix block size bug
a85aa69 
Signed-off-by: LookAround <[email protected]>
@LookAround0301 @FENP
[bug fix] fix block size bug
880ddbf 
Signed-off-by: LookAround <[email protected]>
@pisceskkk
support cp for flashinfer
de86d38 
Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
Merge remote-tracking branch 'origin/context-parallel-flashinfer' int…
abc6470 
…o long_seq_dev

Signed-off-by: QiuChunshuo <[email protected]>
@LookAround0301
[scheduler] support cp
f8afd97 
Signed-off-by: LookAround <[email protected]>
@mergify
Copy link

mergify bot commented Oct 3, 2025

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @LookAround0301.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify bot added the needs-rebase label Oct 3, 2025
@zhangsicheng5 zhangsicheng5 mentioned this pull request Oct 14, 2025
Merged
5 tasks
@pisceskkk pisceskkk mentioned this pull request Oct 14, 2025
Open
11 tasks
pisceskkk and others added 8 commits October 14, 2025 13:06
@pisceskkk
[flashinfer] Vectorized custom_mask computation
cdf2495 
Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[bugfix] add cp_world_size&cp_rank to AttentionImpl
50ab73c 
Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[format] break too long lines and add assert for variables of uncerta…
67b052c 
…in type

Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[format] Rename to distinguish different types of variables
b461a55 
Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[format] add error for unreachable branch.
c9fd35a 
Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[Perf] Persist some variables that require round-by-round initializat…
3212997 
…ion.

Signed-off-by: QiuChunshuo <[email protected]>
@pisceskkk
[format] isort
51cb1f2 
Signed-off-by: QiuChunshuo <[email protected]>
@LookAround0301
Merge pull request #3 from pisceskkk/long_seq_dev
9f8290e 
[Feature] support multi-requests
@mergify mergify bot mentioned this pull request Oct 15, 2025
Closed
3 tasks
@FENP
Copy link
Contributor

FENP commented Oct 15, 2025

A new open PR #26864 replaces this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@heheda12345 heheda12345 Awaiting requested review from heheda12345 heheda12345 will be requested when the pull request is marked ready for review heheda12345 is a code owner

@WoosukKwon WoosukKwon Awaiting requested review from WoosukKwon WoosukKwon will be requested when the pull request is marked ready for review WoosukKwon is a code owner

@robertgshaw2-redhat robertgshaw2-redhat Awaiting requested review from robertgshaw2-redhat robertgshaw2-redhat will be requested when the pull request is marked ready for review robertgshaw2-redhat is a code owner

@njhill njhill Awaiting requested review from njhill njhill will be requested when the pull request is marked ready for review njhill is a code owner

@ywang96 ywang96 Awaiting requested review from ywang96 ywang96 will be requested when the pull request is marked ready for review ywang96 is a code owner

@alexm-redhat alexm-redhat Awaiting requested review from alexm-redhat alexm-redhat will be requested when the pull request is marked ready for review alexm-redhat is a code owner

@ApostaC ApostaC Awaiting requested review from ApostaC ApostaC will be requested when the pull request is marked ready for review ApostaC is a code owner

@mgoin mgoin Awaiting requested review from mgoin mgoin will be requested when the pull request is marked ready for review mgoin is a code owner

@pavanimajety pavanimajety Awaiting requested review from pavanimajety pavanimajety will be requested when the pull request is marked ready for review pavanimajety is a code owner

@LucasWilkinson LucasWilkinson Awaiting requested review from LucasWilkinson LucasWilkinson will be requested when the pull request is marked ready for review LucasWilkinson is a code owner

@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao will be requested when the pull request is marked ready for review youkaichao is a code owner

@tlrmchlsmth tlrmchlsmth Awaiting requested review from tlrmchlsmth tlrmchlsmth will be requested when the pull request is marked ready for review tlrmchlsmth is a code owner

@houseroad houseroad Awaiting requested review from houseroad houseroad will be requested when the pull request is marked ready for review houseroad is a code owner

@hmellor hmellor Awaiting requested review from hmellor hmellor will be requested when the pull request is marked ready for review hmellor is a code owner

@yewentao256 yewentao256 Awaiting requested review from yewentao256 yewentao256 will be requested when the pull request is marked ready for review yewentao256 is a code owner

@ProExpertProg ProExpertProg Awaiting requested review from ProExpertProg ProExpertProg will be requested when the pull request is marked ready for review ProExpertProg is a code owner

@zhuohan123 zhuohan123 Awaiting requested review from zhuohan123 zhuohan123 will be requested when the pull request is marked ready for review zhuohan123 is a code owner

Assignees

No one assigned

Labels

needs-rebase v1

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@LookAround0301 @FENP @pisceskkk