Skip to content

Fixes Extended grammar optimization mode would crash if TopK sampling is set to zero.#1282

Merged
martindevans merged 1 commit intoSciSharp:masterfrom
SerialKicked:fix-grammar-topk
Oct 19, 2025
Merged

Fixes Extended grammar optimization mode would crash if TopK sampling is set to zero.#1282
martindevans merged 1 commit intoSciSharp:masterfrom
SerialKicked:fix-grammar-topk

Conversation

@SerialKicked
Copy link
Contributor

Fixes the crash I identified in #1281 between grammar optimization and TopK sampling. In summary, now the GrammarOptimizationMode.Extended code runs only if TopK is set to something above zero.

@martindevans
Copy link
Member

Thanks for fixing this. I'm not sure what's wrong the the docs updater action, but I don't think it's anything wrong with this PR.

@SerialKicked
Copy link
Contributor Author

You're very welcome, I'm just happy I can run structured output properly :)

(And yeah, I doubt it has anything to do with my change)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants