Add T5 model #145

Merged

LouisCastricato merged 34 commits intoCarperAI:mainfrom

PhungVanDuy:add_t5

Jan 9, 2023

Commits on Dec 20, 2022

add t5 to trlx
Duy Phung
committed
add t5 examples for sentiment
Duy Phung
committed
add eval for t5
Duy Phung
committed
fix eval
Duy Phung
committed

Commits on Dec 21, 2022

remove old files
Duy Phung
committed
remove bad files
Duy Phung
committed
remove bad files
Duy Phung
committed
fix incompatible with gpt model, add summarization code base
Duy Phung
committed
freeze frozen branch
Duy Phung
committed
Merge branch 'main' into add_t5
PhungVanDuy
authored

Commits on Dec 25, 2022

fix evaluation bug t5, add summarization cnn/daily mail example
Duy Phung
committed

Commits on Dec 27, 2022

update sentiment example
Duy Phung
committed
stable config sentiment
Duy Phung
committed

Commits on Dec 29, 2022

add attention mask decoder
Duy Phung
committed

Commits on Dec 31, 2022

setting worked - flant5 two unfrozen small rollouts
Duy Phung
committed

Commits on Jan 1, 2023

merge newest code from main
Duy Phung
committed

Commits on Jan 2, 2023

fix head nn, config cnn daily mail, remove sent examples
Duy Phung
committed

Commits on Jan 6, 2023

fix style, change model_arch_type, truncated tokenizer fixed
Duy Phung
committed
fix style
Duy Phung
committed
precommit changes
Duy Phung
committed

Commits on Jan 7, 2023

fix ppo state values for t5
Duy Phung
committed
Merge branch 'main' into add_t5
PhungVanDuy
authored
fix style
Duy Phung
committed
remove sentiment example
Duy Phung
committed
fix typo
Duy Phung
committed
fix ppo for causal models, add save best, seperate rollouts/eval args
Duy Phung
committed
add ppo sentiment
Duy Phung
committed

Commits on Jan 8, 2023

fix rewards typo
Duy Phung
committed
Merge branch 'main' into add_t5
PhungVanDuy
authored
merging with main
Duy Phung
committed
fix style
Duy Phung
committed

Commits on Jan 9, 2023

add docstring for gen_kwargs_inference, save best
Duy Phung
committed
add gen kwargs support for rollouts sampling
Duy Phung
committed
Make summarization example self-contained
jon-tow
committed