about vllm healthy check on k8s

[allenhaozi]

Deploying vllm on k8s For service stability, healthy check is configured

1. TCP check

2. real llm request

3. healthy check api

4. tcp is a little simple

5. real request relative resource consumption

Can we add a simple calculation to provide check as follows

@app.get("/healthz")
async def health_check():
    """Health check"""
    # a simple compute

if it works, I would like to contribute this pr

[nivibilla]

see #1244

[simon-mo]

health endpoint has been added in recent versions.