Skip to content
This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Commit 65419f4

Browse files
WoosukKwonRobert Shaw
authored andcommitted
[Bugfix] Fix typo in Pallas backend (vllm-project#5558)
1 parent 5fffeb8 commit 65419f4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/attention/backends/pallas.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,7 @@ def __init__(
110110
raise NotImplementedError("TPU version must be 4 or higher.")
111111

112112
self.megacore_mode = None
113-
tpu_type = torch_xla.tpu.get_tp_groupu_env()["TYPE"].lower()
113+
tpu_type = torch_xla.tpu.get_tpu_env()["TYPE"].lower()
114114
if not tpu_type.endswith("lite"):
115115
if self.num_kv_heads % 2 == 0:
116116
self.megacore_mode = "kv_head"

0 commit comments

Comments
 (0)