Awq moe#15

dsikka wants to merge 5 commits intotemp-moe-eliza-zp-branchneuralmagic/vllm:temp-moe-eliza-zp-branchfrom

awq_moeneuralmagic/vllm:awq_moeCopy head branch name to clipboard