Skip to content

[V1][Metrics] Add GPU prefix cache hit rate % gauge#12592

Merged
comaniac merged 7 commits intovllm-project:mainfrom
comaniac:v1-cache-metric-2
Feb 11, 2025
Merged

[V1][Metrics] Add GPU prefix cache hit rate % gauge#12592
comaniac merged 7 commits intovllm-project:mainfrom
comaniac:v1-cache-metric-2

Commits

Commits on Feb 10, 2025