Skip to content

Commit 4a8cfc7

Browse files
[Bugfix] Fix deepseek-v2 error: "missing 1 required positional argument: 'residual'" (#13802)
1 parent bc32bc7 commit 4a8cfc7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/deepseek_v2.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -614,7 +614,7 @@ def forward(
614614
residual = intermediate_tensors["residual"]
615615

616616
for layer in self.layers[self.start_layer:self.end_layer]:
617-
hidden_states, residual = layer(positions, hidden_states)
617+
hidden_states, residual = layer(positions, hidden_states, residual)
618618

619619
if not get_pp_group().is_last_rank:
620620
return IntermediateTensors({

0 commit comments

Comments
 (0)