Skip to content

Even better Q4_0 KV cache (CPU)#1556

Merged
ikawrakow merged 1 commit intomainfrom
ik/better_q40_kv_cache_cpu
Mar 31, 2026
Merged

Even better Q4_0 KV cache (CPU)#1556
ikawrakow merged 1 commit intomainfrom
ik/better_q40_kv_cache_cpu

Commits

Commits on Mar 30, 2026