Skip to content

Commit 1152af4

Browse files
SolitaryThinkergarg-amit
authored andcommitted
[Core/Bugfix] pass VLLM_ATTENTION_BACKEND to ray workers (vllm-project#8172)
Signed-off-by: Amit Garg <[email protected]>
1 parent ff15e13 commit 1152af4

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vllm/executor/ray_gpu_executor.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -242,6 +242,9 @@ def sort_by_driver_then_worker_ip(worker):
242242
VLLM_INSTANCE_ID,
243243
"VLLM_TRACE_FUNCTION":
244244
str(envs.VLLM_TRACE_FUNCTION),
245+
**({
246+
"VLLM_ATTENTION_BACKEND": envs.VLLM_ATTENTION_BACKEND
247+
} if envs.VLLM_ATTENTION_BACKEND is not None else {})
245248
}, ) for (node_id, _) in worker_node_and_gpu_ids]
246249

247250
self._env_vars_for_all_workers = (

0 commit comments

Comments
 (0)