Skip to content

models : fix assert in mamba2 (cont)#20335

Merged
ggerganov merged 2 commits intomasterfrom
gg/models-fix-mamba2-2
Mar 10, 2026
Merged

models : fix assert in mamba2 (cont)#20335
ggerganov merged 2 commits intomasterfrom
gg/models-fix-mamba2-2

Conversation

@ggerganov
Copy link
Copy Markdown
Member

cont #20270

I think we actually only need d_inner % d_state == 0.

@ggerganov ggerganov requested a review from CISC as a code owner March 10, 2026 08:12
@github-actions github-actions bot added the model Model specific label Mar 10, 2026
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@ggerganov ggerganov merged commit 1274fbe into master Mar 10, 2026
7 of 75 checks passed
@ggerganov ggerganov deleted the gg/models-fix-mamba2-2 branch March 10, 2026 13:00
ProgenyAlpha pushed a commit to ProgenyAlpha/llama.cpp that referenced this pull request Mar 12, 2026
* models : fix assert in mamba2 (cont)

* cont : add n_group mod

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Ethan-a2 pushed a commit to Ethan-a2/llama.cpp that referenced this pull request Mar 20, 2026
* models : fix assert in mamba2 (cont)

* cont : add n_group mod

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

model Model specific

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants