Skip to content

Commit 7151f92

Browse files
authored
[Misc] Fix spec decode example (#20296)
Signed-off-by: Woosuk Kwon <[email protected]>
1 parent e28533a commit 7151f92

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

examples/offline_inference/spec_decode.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -79,9 +79,7 @@ def main():
7979
trust_remote_code=True,
8080
tensor_parallel_size=args.tp,
8181
enable_chunked_prefill=args.enable_chunked_prefill,
82-
max_num_batched_tokens=args.max_num_batched_tokens,
8382
enforce_eager=args.enforce_eager,
84-
max_num_seqs=args.max_num_seqs,
8583
gpu_memory_utilization=0.8,
8684
speculative_config=speculative_config,
8785
disable_log_stats=False,

0 commit comments

Comments
 (0)