Skip to content

add specu_decoding support for Mixtral,qwen2,qwen2-moe

c6deb6f
Select commit
Loading
Failed to load commit list.
Merged

Add more model support for speculate_decoding and refactor speculate_decoding #9504

add specu_decoding support for Mixtral,qwen2,qwen2-moe
c6deb6f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs