Skip to content

Commit 8a8e5cb

Browse files
tjohnson31415garg-amit
authored andcommitted
[Bugfix] example template should not add parallel_tool_prompt if tools is none (vllm-project#9007)
Signed-off-by: Amit Garg <[email protected]>
1 parent 23c8ffb commit 8a8e5cb

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

examples/tool_chat_template_mistral_parallel.jinja

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,7 @@
66
{%- endif %}
77
{%- if not tools is defined %}
88
{%- set tools = none %}
9-
{%- endif %}
10-
{%- if tools is defined %}
9+
{%- elif tools is not none %}
1110
{%- set parallel_tool_prompt = "You are a helpful assistant that can call tools. If you call one or more tools, format them in a single JSON array or objects, where each object is a tool call, not as separate objects outside of an array or multiple arrays. Use the format [{\"name\": tool call name, \"arguments\": tool call arguments}, additional tool calls] if you call more than one tool. If you call tools, do not attempt to interpret them or otherwise provide a response until you receive a tool call result that you can interpret for the user." %}
1211
{%- if system_message is defined %}
1312
{%- set system_message = parallel_tool_prompt + "\n\n" + system_message %}

0 commit comments

Comments
 (0)