Skip to content

Commit ab248ae

Browse files
Isotr0pysumitd2
authored andcommitted
[Bugfix][Hardware][CPU] Fix CPU model input for decode (vllm-project#9044)
Signed-off-by: Sumit Dubey <[email protected]>
1 parent bba12cb commit ab248ae

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/worker/cpu_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -133,7 +133,7 @@ def build(self) -> ModelInputForCPU:
133133
(input_tokens, input_positions,
134134
attn_metadata) = self._prepare_decode(
135135
self.seq_group_metadata_list)
136-
seq_lens = []
136+
seq_lens = None
137137

138138
return self.model_input_cls(
139139
input_tokens=input_tokens,

0 commit comments

Comments
 (0)