Skip to content

Add some metrics for kvcache#5187

Closed
aftersnow wants to merge 1 commit intosgl-project:mainfrom
aftersnow:feature/upstream-add-metrics
Closed

Add some metrics for kvcache#5187
aftersnow wants to merge 1 commit intosgl-project:mainfrom
aftersnow:feature/upstream-add-metrics

Conversation

@aftersnow
Copy link
Copy Markdown
Contributor

@aftersnow aftersnow commented Apr 9, 2025

Motivation

Add more metrics for tracking kvcache related information.

Modifications

The new metrics are:

  • mempool_size: the size of the memory pool
  • mempool_available_siz: the available size of the memory pool
  • tree_cache_size: the size of the tree cache
  • tree_cache_evictable_size: the evictable size of the tree cache
  • retract_count: the number of retracted requests

Checklist

Signed-off-by: winters.zc <winters.zc@antgroup.com>
@aftersnow
Copy link
Copy Markdown
Contributor Author

pls see #7030

@aftersnow aftersnow closed this Jun 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant