We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e870757 commit f6b8afeCopy full SHA for f6b8afe
tests/spec_decode/e2e/test_ngram_correctness.py
@@ -14,7 +14,7 @@
14
For ngram lookup, its idea comes from https://github.com/apoorvumang/prompt-lookup-decoding,
15
and is merged into transform code base: https://github.com/huggingface/transformers/pull/27775.
16
Since there is no model is needed for generate the proposal, we could make
17
-the testcase much simplier than drafter multi-step one.
+the testcase much simpler than drafter multi-step one.
18
19
However, we still need to verify below scenario could be passed:
20
* Batch size 1 greedy equality
0 commit comments