Skip to content

Commit c1e3a38

Browse files
committed
format
Signed-off-by: pyc96 <[email protected]>
1 parent 637d366 commit c1e3a38

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/spec_decode/draft_model_runner.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -303,8 +303,9 @@ def execute_model(
303303

304304
if self.return_hidden_states and is_fallback:
305305
if use_cuda_graph:
306-
indices = model_input.sampling_metadata.selected_token_indices
307-
output.hidden_states = hidden_states[: len(indices)]
306+
indices = model_input.sampling_metadata\
307+
.selected_token_indices
308+
output.hidden_states = hidden_states[:len(indices)]
308309
else:
309310
output.hidden_states = hidden_states
310311

0 commit comments

Comments
 (0)