MXFP4#682

Merged

ikawrakow merged 14 commits intomainfrom

Aug 9, 2025

Commits on Aug 8, 2025

mxfp4: basics
Iwan Kawrakow
committed
mxfp4: Zen4 GEMM
Iwan Kawrakow
committed
mxfp4: repacked GEMM (AVX2/Zen4)
Iwan Kawrakow
committed
mxfp4: AVX2 GEMM
Iwan Kawrakow
committed
mxfp4: NEON GEMM
Iwan Kawrakow
committed
mxfp4: repacked GEMM (NEON)
Iwan Kawrakow
committed
mxfp4: Metal
Iwan Kawrakow
committed
Fix quantized K cache without FA (#680)

ikawrakow
and
Iwan Kawrakow
committed
Fix for Deepseek r1 parsing (#676)

iSevenDays
authored and
Iwan Kawrakow
committed
Port cpu moe options from mainline (#672)

TheLegendOfKitty
authored and
Iwan Kawrakow
committed
maxfp4: CUDA dequantize
Iwan Kawrakow
committed
mxfp4: CUDA GEMV
Iwan Kawrakow
committed
mxfp4: CUDA MMQ
Iwan Kawrakow
committed

Commits on Aug 9, 2025

mxfp4: minor CUDA tweaks
Iwan Kawrakow
committed