Skip to content

Enhance w4afp8 performance: implement per-token w4afp8 CUTLASS MoE GEMM for FP8 dispatch, improve performance with w4afp8 moe gemm #18144

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Wangzheee wants to merge 0 commits into from
+0 −0

Wangzheee:w4afp8_per-token-kernel was force-pushed and no longer has any new commits.

Pushing new commits will allow the pull request to be re-opened.