[feat] KvCompOnDevice: per-KV-head Top-K for Qwen#588

mag1c-h merged 1 commit intoModelEngine-Group:0.2.0-releaseModelEngine-Group/unified-cache-management:0.2.0-releasefrom

wangwenxin0312:dev_kvcomp_qwenwangwenxin0312/unified-cache-management:dev_kvcomp_qwenCopy head branch name to clipboard