Skip to content

🚀 Scaling GRPO to 70B+ Models and Multi-Node Training with vLLM Server & NCCL Communication#3094

Merged
qgallouedec merged 81 commits intohuggingface:mainfrom
binary-husky:main
Mar 21, 2025
Merged

🚀 Scaling GRPO to 70B+ Models and Multi-Node Training with vLLM Server & NCCL Communication#3094
qgallouedec merged 81 commits intohuggingface:mainfrom
binary-husky:main

Commits

Commits on Mar 17, 2025

Commits on Mar 18, 2025

Commits on Mar 19, 2025

Commits on Mar 20, 2025

Commits on Mar 21, 2025