Support using FlexKV on TensorRT-LLM#48

Merged

zhuofan1123 merged 49 commits intotaco-project:devfrom

axxx03:features/add_trtllm_v2

Nov 19, 2025

Commits on Nov 19, 2025

prevent automatically initializing MPI

zhuofan1123
authored and
axxx03
committed
disable auto-mpi-init

linhu-nv
authored and
axxx03
committed
Init support for TensorRT-LLM
axxx03
committed
add scripts
axxx03
committed
fix import and interface
axxx03
committed
support the trtllm gpu layout and improve register api of trt_adapter

Luis-xu
authored and
axxx03
committed
modify log
axxx03
committed
modify scripts
axxx03
committed
use remote transfermanager

zhuofan1123
authored and
axxx03
committed
some fix by hulin
axxx03
committed
using subprocess instead of multiprocessing
axxx03
committed
fix dead lock
axxx03
committed
fix some bugs about gpu_register_port

myNameAnn
authored and
axxx03
committed
fix tensor export

myNameAnn
authored and
axxx03
committed
fix head_size
axxx03
committed
fix num_kv_heads for deepseek
axxx03
committed
fix ipc open error

peaceforeverCN
authored and
axxx03
committed
fix head_size calculationg error

Luis-xu
authored and
axxx03
committed
fix interface
axxx03
committed
fix get num_matched_tokens from trtllm

Luis-xu
authored and
axxx03
committed
fix head_size calculationg error

Luis-xu
authored and
axxx03
committed
fix interface
axxx03
committed
fix short len
axxx03
committed
remove code
axxx03
committed
add patch file
axxx03
committed
modify scripts
axxx03
committed
tensorRT LLM will wait until kvmanager isready
axxx03
committed
[bugfix] fix token alignment issue in tensorrt-llm by rounding down to block size

peaceforeverCN
authored and
axxx03
committed
trivial
axxx03
committed
support flexkv + cuda graph using flexkv
axxx03
committed
modify patch
axxx03
committed
modify scripts
axxx03
committed
[bugfix] fix some bug

peaceforeverCN
authored and
axxx03
committed
fix redix_tree
axxx03
committed
modify scripts
axxx03
committed
add debug log
axxx03
committed
modify scripts
axxx03
committed
fix rebase error
axxx03
committed
fix radix tree
axxx03
committed
fix scripts
axxx03
committed
use new config
axxx03
committed
rename
axxx03
committed
fix script
axxx03
committed
add branch for calculation of aligned_length
axxx03
committed
add branch for remote_process
axxx03
committed
take another way to determine branch
axxx03
committed
fux scripts
axxx03
committed
remove useless env and config
axxx03
committed
remove useless commit
axxx03
committed