Skip to content

llama-fit-params: fix underflow for dense models#18095

Merged
JohannesGaessler merged 1 commit intoggml-org:masterfrom
JohannesGaessler:llama-fp-fix-dense-underflow
Dec 16, 2025
Merged

llama-fit-params: fix underflow for dense models#18095
JohannesGaessler merged 1 commit intoggml-org:masterfrom
JohannesGaessler:llama-fp-fix-dense-underflow

Conversation

@JohannesGaessler
Copy link
Contributor

Fixes #18087 .

The way the number of unassigned layers are being calculated is not quite correct, resulting in a numerical underflow because a value is unintentionally being subtracted more than once.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Misc. bug: Nonsensical suggested fit params for dense models

2 participants