[fix] Update `AdaptiveKLController` with correct KL#361

Merged

Dahoas merged 1 commit intomainfrom

fix-kl-controller

Mar 13, 2023

Commits on Mar 8, 2023

fix(ppo_trainer): update `AdaptiveKLController` with correct KL
maxreciprocate
committed