Skip to content

server: improve speed of speculative decoding#1119

Merged
ikawrakow merged 2 commits intomainfrom
fcp/speculative_imprv
Jan 10, 2026
Merged

server: improve speed of speculative decoding#1119
ikawrakow merged 2 commits intomainfrom
fcp/speculative_imprv

Commits

Commits on Jan 7, 2026

Commits on Jan 8, 2026