Releases: lucidrains/x-transformers
Releases · lucidrains/x-transformers
0.0.24
make sure masks work with funnel transformer
0.0.23
make sure each bottleneck section in funnel transformer share a diffe…
0.0.22
add funnel transformer
0.0.21
fix encoder feedforward glu
0.0.20
fix bug with encoder relative pos emb
0.0.19
add dropouts
0.0.18
add memory tokens, from Memory Transformers paper
0.0.17
add all-attention memory key/values, set with `attn_num_mem_kv = {int}`
0.0.16
add ability to use entmax15 for sparse attention
0.0.15
bump