Skip to content

Commit e2c5919

Browse files
yanyc428lulmer
authored andcommitted
[Bugfix] Fix tqdm progress bar when SamplingParams.n > 1 (vllm-project#12428)
Signed-off-by: Yuchen Yan <[email protected]> Signed-off-by: Louis Ulmer <[email protected]>
1 parent 299def2 commit e2c5919

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/entrypoints/llm.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1394,7 +1394,9 @@ def _run_engine(
13941394
pbar.postfix = (
13951395
f"est. speed input: {in_spd:.2f} toks/s, "
13961396
f"output: {out_spd:.2f} toks/s")
1397-
pbar.update(1)
1397+
pbar.update(len(output.outputs))
1398+
else:
1399+
pbar.update(1)
13981400

13991401
if use_tqdm:
14001402
pbar.close()

0 commit comments

Comments
 (0)