Skip to content

Commit 86fd8bb

Browse files
authored
Add warning to prevent changes to benchmark api server (#2858)
1 parent ab3a5a8 commit 86fd8bb

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

vllm/entrypoints/api_server.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,9 @@
1+
"""
2+
NOTE: This API server is used only for demonstrating usage of AsyncEngine and simple performance benchmarks.
3+
It is not intended for production use. For production use, we recommend using our OpenAI compatible server.
4+
We are also not going to accept PRs modifying this file, please change `vllm/entrypoints/openai/api_server.py` instead.
5+
"""
6+
17
import argparse
28
import json
39
from typing import AsyncGenerator

0 commit comments

Comments
 (0)