[V1][Metrics] Add GPU prefix cache hit rate % gauge#12592
Merged
comaniac merged 7 commits intovllm-project:mainfrom Feb 11, 2025
Merged
[V1][Metrics] Add GPU prefix cache hit rate % gauge#12592comaniac merged 7 commits intovllm-project:mainfrom
comaniac merged 7 commits intovllm-project:mainfrom