Skip to content

Commit 43999c3

Browse files
youkaichaojimpang
authored andcommitted
[doc][distributed] fix doc argument order (vllm-project#6691)
1 parent 1632356 commit 43999c3

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

docs/source/serving/distributed_serving.rst

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -66,8 +66,8 @@ Pick a node as the head node, and run the following command:
6666
$ bash run_cluster.sh \
6767
$ vllm/vllm-openai \
6868
$ ip_of_head_node \
69-
$ /path/to/the/huggingface/home/in/this/node \
70-
$ --head
69+
$ --head \
70+
$ /path/to/the/huggingface/home/in/this/node
7171
7272
On the rest of the worker nodes, run the following command:
7373

@@ -76,8 +76,8 @@ On the rest of the worker nodes, run the following command:
7676
$ bash run_cluster.sh \
7777
$ vllm/vllm-openai \
7878
$ ip_of_head_node \
79-
$ /path/to/the/huggingface/home/in/this/node \
80-
$ --worker
79+
$ --worker \
80+
$ /path/to/the/huggingface/home/in/this/node
8181
8282
Then you get a ray cluster of containers. Note that you need to keep the shells running these commands alive to hold the cluster. Any shell disconnect will terminate the cluster.
8383

0 commit comments

Comments
 (0)