We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent bb60326 commit 8893130Copy full SHA for 8893130
examples/api_client.py
@@ -1,4 +1,9 @@
1
-"""Example Python client for vllm.entrypoints.api_server"""
+"""Example Python client for vllm.entrypoints.api_server
2
+NOTE: The API server is used only for demonstration and simple performance
3
+benchmarks. It is not intended for production use.
4
+For production use, we recommend vllm.entrypoints.openai.api_server
5
+and the OpenAI client API
6
+"""
7
8
import argparse
9
import json
0 commit comments