Skip to content

[Feature]: json_schema support in OpenAI compat server #7656

@rockwotj

Description

@rockwotj

🚀 The feature, motivation and pitch

It would be great now that OpenAI supports JSONSchema to be able to support the repsonse_format.type == 'json_schema' in vLLM to make it easy to switch between the two formats.

Alternatives

No response

Additional context

https://platform.openai.com/docs/guides/structured-outputs/

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions