Fix Batching Issues#1045

Merged

martindevans merged 2 commits intoSciSharp:masterfrom

martindevans:investigate_batching_issues

Jan 17, 2025

Commits on Jan 11, 2025

Initial investigation into potential issue with batched executor (or batching in general)
martindevans
committed

Commits on Jan 17, 2025

- Removed the automatic shared token mechanism in LLamaBatch, it was causing problems with tokens that should never have been shared.
martindevans
committed