Skip to content

[Feature] Add support for the new 'prediction' parameter in openai  #735

@narengogi

Description

@narengogi

What Would You Like to See with the Gateway?

this parameter is used to reduce prediction costs
https://platform.openai.com/docs/guides/latency-optimization#use-predicted-outputs
https://platform.openai.com/docs/api-reference/chat/create

Context for your Request

No response

Your Twitter/LinkedIn

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions