About using vLLM integration as general generation tool for custom training loops

[daniel-dona]

A lot of work have been put to integrate GRPO with vLLM as a way to speed up online inferencing during training, could be great to generalize the integration in a way it could be used in custom training loops.

I'm thinking for example as a way of completions sampling during training, or performing custom evaluations that require completions.