Skip to content

[V1][Minor] Print KV cache size in token counts#13596

Merged
WoosukKwon merged 1 commit intomainfrom
v1-mem-log
Feb 20, 2025
Merged

[V1][Minor] Print KV cache size in token counts#13596
WoosukKwon merged 1 commit intomainfrom
v1-mem-log

Commits

Commits on Feb 20, 2025