Skip to content

Commit ceb2133

Browse files
authored
Update vllm example smart_voice params (#69)
1 parent 851208c commit ceb2133

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

examples/vllm/run_chat_completion.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,10 @@ def run_smart_voice() -> None:
4444
],
4545
model=model,
4646
modalities=["text", "audio"],
47-
audio={"format": "wav"},
47+
temperature=1.0,
48+
top_p=0.95,
49+
extra_body={"top_k": 50},
50+
stop=["<|eot_id|>", "<|end_of_text|>", "<|audio_eos|>"],
4851
)
4952

5053
text = chat_completion.choices[0].message.content

0 commit comments

Comments
 (0)