Skip to content

Commit 234eb29

Browse files
committed
[Bugfix] Fix non-default argument error
Fix bug due to vllm-project/vllm#24278 Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
1 parent c1509f5 commit 234eb29

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

tpu_commons/runner/input_batch_jax.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@
2323
@dataclass
2424
class CachedRequestState(NewRequestData):
2525

26-
output_token_ids: list[int]
26+
output_token_ids: list[int] = None
2727
generator: Optional[Any] = None
2828
mrope_positions: Optional[jax.Array] = None
2929
mrope_position_delta: Optional[int] = None

0 commit comments

Comments
 (0)