[New Model]: allenai/Molmo-7B-0-0924 VisionLM

[K-Mistele]

The model to consider.

https://huggingface.co/allenai/Molmo-7B-O-0924
https://huggingface.co/collections/allenai/molmo-66f379e6fe3b8ef090a8ca19

The closest model vllm already supports.

Existing Olmo Models by AllenAi: OLMoForCausalLM and OLMoEForCausalLM are supported.

What's your difficulty of supporting the model you want?

Molmo is a vision LM, so unlike the previous Olmo models by Allen AI, this model includes vision.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[davidsyoung]

+1

Of note, Molmo-72B-0924 seems to be benchmarking as SOTA open source model, beating many closed models. It also performs much better than Llama 3.2 models. It would be great to have this model supported.

More information here:

https://huggingface.co/allenai/Molmo-72B-0924
https://molmo.allenai.org/blog
https://molmo.allenai.org/paper.pdf

[galatolofederico]

+1 If it's not already done by this weekend, I can try handle it then

[sharanks8]

how to get the onnx version of the model?

[Gokul10272001]

+1 If it's not already done by this weekend, I can try handle it then

how to do it by ourself ?

[ywang96]

We're a bit overwhelmed by things to work on, so any help/contribution is definitely welcomed! Supporting this model should be straightforward since it's also LlaVA-style like many other VLMs we support today.

If anyone decides to make a PR to support this model, please ping me directly for review once it's ready!

[mrsalehi]

Hello, I'm with the Molmo team at Ai2. We'll soon be adding our models to vllm, so stay tuned!

[stellanhaglund]

Hello, I'm with the Molmo team at Ai2. We'll soon be adding our models to vllm, so stay tuned!

Nice, will that include molmoe?

[mrsalehi]

Hello, I'm with the Molmo team at Ai2. We'll soon be adding our models to vllm, so stay tuned!

Nice, will that include molmoe?

yes

[SinanAkkoyun]

@mrsalehi Thank you! Do you know when approximately?

[SinanAkkoyun]

And when will you release the dataset?

[mrsalehi]

@mrsalehi Thank you! Do you know when approximately?

Most likely today or tomorrow.

[premg16]

does the support included in the release 0.6.2?