Interleave 8 rows (Q8_0, IQ4_XS)#178

Merged

ikawrakow merged 10 commits intomainfrom

ik/iq4_xs_r8_v2

Jan 27, 2025

Commits on Jan 25, 2025

Try interleaving 8 rows for iq4_xs
Iwan Kawrakow
committed
Try interleaving 8 iq4_xs rows
Iwan Kawrakow
committed
Cleanup
Iwan Kawrakow
committed

Commits on Jan 26, 2025

8-rows interleaved q8_0 (AVX2)
Iwan Kawrakow
committed
8-rows interleaved q8_0 (Zen4)
Iwan Kawrakow
committed
8-rows interleaved q8_0 (Zen4) - slightly better
Iwan Kawrakow
committed
8-rows interleaved q8_0 (NEON)
Iwan Kawrakow
committed
FA: repack Q8_0 to Q8_0_R8
Iwan Kawrakow
committed
Remove special purpose mul_mat_q8_0_r4_q8_1_128 (Zen4)
Iwan Kawrakow
committed
FA: repack Q8_0 to Q8_0_R8 (NEON)
Iwan Kawrakow
committed