Commit 768dee1
Fix llama.cpp latent steps: request embeddings on every step
Setting logits[0]=1 only on the last step prevented
llama_get_embeddings_ith from returning hidden states on
intermediate steps, so the same initial hidden state was
re-injected N-1 times instead of iteratively refining.
Now matches the HuggingFace connector and avp-agent behavior.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>1 parent 2f05ab6 commit 768dee1
1 file changed
+1
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
241 | 241 | | |
242 | 242 | | |
243 | 243 | | |
244 | | - | |
| 244 | + | |
245 | 245 | | |
246 | 246 | | |
247 | 247 | | |
| |||
0 commit comments