Skip to content

Load all MoE experts during warmup and make warmup 1 token#198

Merged
ikawrakow merged 2 commits intomainfrom
s6/warmup
Feb 10, 2025
Merged

Load all MoE experts during warmup and make warmup 1 token#198
ikawrakow merged 2 commits intomainfrom
s6/warmup

Commits

Commits on Feb 9, 2025