Skip to content

[Frontend] OpenAI server: propagate usage accounting to FastAPI middleware layer#8672

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom
agt:pr/usage-propagation
Sep 25, 2024
Merged

[Frontend] OpenAI server: propagate usage accounting to FastAPI middleware layer#8672
DarkLight1337 merged 2 commits intovllm-project:mainfrom
agt:pr/usage-propagation

Commits

Commits on Sep 24, 2024