Various fixes regarding special tokens (embeddings & anti-prompt)#1112

Merged

martindevans merged 3 commits intoSciSharp:masterfrom

Lyrcaxis:special-fixes

Feb 26, 2025

Commits on Feb 26, 2025

Fixed special tokens parsing as plain text in LLamaEmbedder
Lyrcaxis
committed
Fixed anti-prompt passing as plain text in InteractiveExecutor
Lyrcaxis
committed
BatchedExecutorBoolQ example now tokenizes special tokens properly
Lyrcaxis
committed