Skip to content

max_tokens mapping question for GROQ and Cerebras #1341

@ianbbqzy

Description

@ianbbqzy

What Would You Like to See with the Gateway?

I tried setting max_tokens for various providers and I found that max_completion_tokens is mapped to max_tokens for many of them such as Deepinfra and Fireworks. But I'm curious why the same isn't done for GROQ and Cerebras.

Context for your Request

No response

Your Twitter/LinkedIn

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions