Releases: lucidrains/x-transformers
Releases · lucidrains/x-transformers
0.2.1
set entmax alpha value to 1.3 as recommended by paper
0.2.0
default to sampling with entmax15, as recommended by the new paper "S…
0.1.1
remove float(-inf) for extra stability
0.1.0
0.1.0
0.0.30
complete macaron net
0.0.29
add sandwich coefficient, from sandwich transformers. also allow user…
0.0.28
add rezero for encoder, decoder, and funnel encoder
0.0.27
fix masking for memory key/values exist
0.0.26
add attention on attention (gating on final attention output, with qu…
0.0.25
fix funnel transformer so that downsample is query-only