Skip to content

Gemma2 models from google #5953

@bks5881

Description

@bks5881

The model to consider.

https://huggingface.co/google/gemma-2-27b-it

The closest model vllm already supports.

gemma

What's your difficulty of supporting the model you want?

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    new-modelRequests to new models

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions