merge dev to main#63

Merged

linhu-nv merged 252 commits intomainfrom

Nov 25, 2025

This pull request is big! We're only showing the most recent 250 commits

Commits on May 14, 2025

fix logic problems in client

linhu-nv
authored and
zhuofan1123
committed
quick fix to client-server example

linhu-nv
authored and
zhuofan1123
committed
fix some bugs to run compile

linhu-nv
authored and
zhuofan1123
committed
modify blockmeta definition & impl mempool
zhuofan1123
committed
impl index
zhuofan1123
committed
add index benchmark
zhuofan1123
committed
faster hash
zhuofan1123
committed
add test for storage_engine + transfer_engine

linhu-nv
authored and
zhuofan1123
committed
optim index
zhuofan1123
committed
fix a few bugs about performance, should have normal perf now

linhu-nv
authored and
zhuofan1123
committed
add mempool benchmark
zhuofan1123
committed
optim mempool
zhuofan1123
committed
optimize index.insert
zhuofan1123
committed
fix mempool
zhuofan1123
committed
eviction implementation and optimization

linhu-nv
authored and
zhuofan1123
committed
fix evictor
zhuofan1123
committed
flatten free ids tensor
zhuofan1123
committed
impl get/put pipeline
zhuofan1123
committed
add reset for cache engine
zhuofan1123
committed
global id allocator
zhuofan1123
committed
list to tensor
zhuofan1123
committed
init kvmanager
zhuofan1123
committed
run the pipeline

linhu-nv
authored and
zhuofan1123
committed
print cpu-gpu transfer info
zhuofan1123
committed
refactor index
zhuofan1123
committed
refactor kvmanager and cache engine
zhuofan1123
committed
add insert_length for insert
zhuofan1123
committed
cleanup buffer
zhuofan1123
committed
Layer wise

linhu-nv
authored and
zhuofan1123
committed
Added the xxhash

PY
authored and
zhuofan1123
committed
add cmake

PY
authored and
zhuofan1123
committed
adapt use xxhash

PY
authored and
zhuofan1123
committed
fix bug
zhuofan1123
committed
refactor
zhuofan1123
committed
fix
zhuofan1123
committed
remove comment
zhuofan1123
committed
add benchmark and refactor code
zhuofan1123
committed
fix bug
zhuofan1123
committed
radix tree
zhuofan1123
committed
update
zhuofan1123
committed
update
zhuofan1123
committed
fix
zhuofan1123
committed
quick fix to ssd file allocation

linhu-nv
authored and
zhuofan1123
committed
remove batch transfer
zhuofan1123
committed
quick fix to transfer_op initialization

linhu-nv
authored and
zhuofan1123
committed
check tensor type
zhuofan1123
committed
support ce transfer
zhuofan1123
committed
modify graph creation
zhuofan1123
committed
remove dataclass
zhuofan1123
committed
fix to illegal memory access

linhu-nv
authored and
zhuofan1123
committed
fix to transfer_op default values

linhu-nv
authored and
zhuofan1123
committed
remove gitlab-ci yml
zhuofan1123
committed
submodule install automatically
zhuofan1123
committed
init README
zhuofan1123
committed

Commits on May 19, 2025

add cython

menyu
authored and
menyu
committed
use multiple processes for transfer workers to bypass GIL
linhu-nv
committed

Commits on May 21, 2025

support different layout && multiple ssd (#3)
zhuofan1123
authored

Commits on May 22, 2025

add debug mode

menyu
authored and
menyu
committed
Merge branch 'dev' into pz/cython

menyu
authored and
menyu
committed
default to debug

menyu
authored and
menyu
committed
default to debug

menyu
authored and
menyu
committed
Merge pull request #1 from nvidia-china-sae/pz/cython
zhuofan1123
authored

Commits on May 23, 2025

Commits on May 25, 2025

Commits on May 29, 2025

Support for multi-SSD read/write and round-robin layout (#8)
zhuofan1123
authored

Commits on May 30, 2025

Commits on Jun 5, 2025

Commits on Jun 6, 2025

Commits on Jun 7, 2025

tp enabled, draft, commited for multi-gpu test
linhu-nv
committed

Commits on Jun 9, 2025

Commits on Jun 10, 2025

Commits on Jun 11, 2025

Commits on Jun 13, 2025

Commits on Jun 16, 2025

Commits on Jun 17, 2025

Merge pull request #27 from nvidia-china-sae/linhu/mla
zhuofan1123
authored

Commits on Jun 18, 2025

refactor graph generation (#28)
zhuofan1123
authored

Commits on Jun 24, 2025

change remote cache: (#30)
peaceforeverCN
authored

Commits on Jun 25, 2025

Commits on Jun 27, 2025

support both layer-wise and block-wise storage for cpu-blocks (#29)

authored

Commits on Jun 30, 2025

quick fix for len(token_ids) < tokens_per_blocks and len(True in mask) < token_per_block (#33)
linhu-nv
authored

Commits on Jul 1, 2025

skip unready block in put (#34)
zhuofan1123
authored

Commits on Jul 3, 2025

io_uring support for ssd cache (#32)
charliecgxu
authored

Commits on Jul 7, 2025

Commits on Jul 8, 2025

Commits on Jul 10, 2025

Commits on Jul 11, 2025

Commits on Jul 15, 2025

Commits on Jul 17, 2025

spread IO to as many files as possible (#49)
charliecgxu
authored

Commits on Jul 19, 2025

refactor pytest: add test_utils; add server-client mode
Fei Liang
committed

Commits on Jul 21, 2025

Commits on Jul 22, 2025

refactor benchmark_cache_engine and fix some issues (#55)
zhuofan1123
authored

Commits on Jul 24, 2025

Commits on Jul 29, 2025

Commits on Jul 30, 2025

reduce bubble between op launch (#65)
zhuofan1123
authored

Commits on Aug 5, 2025

some small fixes (#66)
linhu-nv
authored

Commits on Aug 11, 2025

remove worker_init_timeout_minutes (#67)
zhuofan1123
authored

Commits on Aug 12, 2025

Commits on Aug 14, 2025

add a message when error (#71)
peaceforeverCN
authored

Commits on Aug 19, 2025

radix tree c++ impl (#70)
charliecgxu
authored

Commits on Aug 20, 2025

Commits on Aug 21, 2025

kvmanager refactor (#73)

authored

Commits on Aug 25, 2025

Commits on Aug 26, 2025

fix direct io
zhuofan1123
committed

Commits on Aug 27, 2025

Commits on Sep 1, 2025

Merge pull request #86 from nvidia-china-sae/main_process_buffer_manager
zhuofan1123
authored

Commits on Sep 2, 2025

add gds

menyu
authored and
nsealati
committed
fix batch sync

menyu
authored and
nsealati
committed
add gds transfer worker support

Fei Liang
authored and
nsealati
committed

Commits on Sep 15, 2025

op-level callback

jianyingzhu
authored and
peaceforeverCN
committed
fix bugs

jianyingzhu
authored and
peaceforeverCN
committed

Commits on Sep 16, 2025

Commits on Sep 17, 2025

Commits on Oct 15, 2025

Commits on Oct 20, 2025

Commits on Oct 21, 2025

remove redundant code
wenpengw-nv
committed

Commits on Oct 27, 2025

Commits on Oct 29, 2025

Merge pull request #25 from wenpengw-nv/wenpengw/gds
peaceforeverCN
authored

Commits on Oct 31, 2025

[feature] Different gtensor layouts (#27)

authored

Commits on Nov 3, 2025

quick fix to benchmark_worker (#31)

linhu-nv
and
myNameAnn
authored

Commits on Nov 4, 2025

[feature] optimize SSD I/O (#33)
zhuofan1123
authored

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Merge pull request #38 from charliecgxu/dev
linhu-nv
authored

Commits on Nov 10, 2025

Commits on Nov 11, 2025

Commits on Nov 14, 2025

Commits on Nov 17, 2025

Commits on Nov 21, 2025

Commits on Nov 25, 2025