Skip to content

v6.0.0

Latest
Latest
Compare
Choose a tag to compare
@chrisociepa chrisociepa released this 11 Apr 14:52
· 9 commits to main since this release
v6.0.0
6043c5c
  • Major refactor
  • Add support for FSDP2 and TP
  • Add support for various activation functions and introduce LRA function
  • Add support for FlexAttention, xFormers, FlashAttention3. Improve custom mask and sliding window handling

Full Changelog: v5.0.0...v6.0.0

Assets 2
Loading