Skip to content

Fused delta-net (AVX512)#1362

Merged
ikawrakow merged 1 commit intomainfrom
ik/fused_delta_net_avx512
Mar 5, 2026
Merged

Fused delta-net (AVX512)#1362
ikawrakow merged 1 commit intomainfrom
ik/fused_delta_net_avx512

Conversation

@ikawrakow
Copy link
Copy Markdown
Owner

On a Ryzen-7950X CPU I observe 3-4% better PP and ~1-2% better TG for Qwen3-Next.

@magikRUKKOLA
Copy link
Copy Markdown

Can wait to test it out on Xeon QYFS!

@Ph0rk0z
Copy link
Copy Markdown

Ph0rk0z commented Mar 4, 2026

It doesn't seem to require fancy_SIMD? Might be able to actually use it.

@ikawrakow ikawrakow merged commit 8fb0022 into main Mar 5, 2026
@ikawrakow
Copy link
Copy Markdown
Owner Author

It doesn't seem to require fancy_SIMD?

It just needs __AVX512F__, so no, no fancy SIMD required.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants