Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
dbb2ab9
Add KVTransferParams, modify all generate interfaces.
ShangmingCai Feb 7, 2025
d031995
Pass kv_transfer_params to model_input in model_runner.
ShangmingCai Feb 7, 2025
3c306b4
Add test for KVTransferParams.
ShangmingCai Feb 8, 2025
ff4b89e
Merge branch 'main' into add_kv_transfer_params
ShangmingCai Feb 8, 2025
56d80c9
fix ruff
ShangmingCai Feb 8, 2025
4d9cc92
fix mypy
ShangmingCai Feb 8, 2025
bcab623
minor
ShangmingCai Feb 8, 2025
10c20c2
fix msgspec type error
ShangmingCai Feb 10, 2025
a45736e
fix v1 error
ShangmingCai Feb 11, 2025
88f81d8
add args
ShangmingCai Feb 11, 2025
1f194db
verified that #12959 can fix distributed-tests-4-gpus ci
ShangmingCai Feb 12, 2025
0395307
retrigger ci
ShangmingCai Feb 12, 2025
0d8ef2c
retrigger ci
ShangmingCai Feb 12, 2025
d33b0dc
Merge branch 'main' into add_kv_transfer_params
ShangmingCai Feb 12, 2025
c373b43
refactor
ShangmingCai Feb 17, 2025
3404057
remove unused import
ShangmingCai Feb 17, 2025
dbece05
fix ruff
ShangmingCai Feb 17, 2025
14b213f
typo
ShangmingCai Feb 17, 2025
943460e
fix isort
ShangmingCai Feb 17, 2025
f261591
minor
ShangmingCai Feb 17, 2025
14da3b9
minor
ShangmingCai Feb 17, 2025
be1a184
add tests
ShangmingCai Feb 18, 2025
5dcad80
fix isort
ShangmingCai Feb 18, 2025
c6f54e0
Merge remote-tracking branch 'upstream/main' into add_kv_transfer_params
ShangmingCai Feb 18, 2025
e428ea4
retrigger ci
ShangmingCai Feb 18, 2025
77701bb
add more tests
ShangmingCai Feb 19, 2025
a1c3f80
Merge remote-tracking branch 'upstream/main' into add_kv_transfer_params
ShangmingCai Feb 19, 2025
35f0961
Merge branch 'main' into add_kv_transfer_params
ShangmingCai Mar 3, 2025
45764f7
retrigger ci after addressing the typing conflicts with 13971
ShangmingCai Mar 3, 2025
f71be5d
try entrypoints test again
ShangmingCai Mar 3, 2025
c463f48
Revert openapi changes
ShangmingCai Mar 14, 2025
9c55445
Merge remote-tracking branch 'upstream/main' into add_kv_transfer_params
ShangmingCai Mar 14, 2025
05bce94
Refactor mooncake xpyd
ShangmingCai Mar 14, 2025
6b98e2b
Fix doc
ShangmingCai Mar 17, 2025
c56b6d3
fix interface
ShangmingCai Mar 17, 2025
e5736b5
fix proxy
ShangmingCai Mar 17, 2025
2aaef25
fix typo
ShangmingCai Mar 17, 2025
a798d31
address comments
ShangmingCai Mar 25, 2025
b366931
add docstring
ShangmingCai Mar 25, 2025
abd1b3f
fix magic numbers
ShangmingCai Mar 27, 2025
8f96f29
Merge remote-tracking branch 'upstream/main' into add_kv_transfer_params
ShangmingCai Mar 29, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading