Add DynamicMoE support for Mixtral#1511

Merged

regisss merged 4 commits intohuggingface:mainfrom

HabanaAI:kwisniewski/dynamicmoe

Dec 3, 2024

Commits on Nov 21, 2024

[SW-205385]Add DynamicMoE support for Mixtral (#10)

kwisniewski98
and
astachowiczhabana
committed
Merge branch 'main' into kwisniewski/dynamicmoe
kwisniewski98
authored

Commits on Nov 25, 2024

Fix tests
kwisniewski98
committed

Commits on Nov 26, 2024

Switch back to non fused moe
kwisniewski98
committed