Support OpenAI API server in benchmark_serving.py
#2172
Merged
benchmark_serving.py
#2172