0.5.6

Full Changelog: 0.5.5...0.5.6

0.5.5

address https://github.com/lucidrains/recurrent-memory-transformer-py…

0.5.4

address https://github.com/lucidrains/recurrent-memory-transformer-py…

0.5.3

allow for customizing whether read memory is stop gradded, the one ad…

0.5.2

reinject the write memory positions

0.5.1

address https://github.com/lucidrains/recurrent-memory-transformer-py…

0.5.0

give a null key / value to protect against entirely masked out row, a…

0.4.3

address https://github.com/lucidrains/recurrent-memory-transformer-py…

0.4.2

address https://github.com/lucidrains/recurrent-memory-transformer-py…

0.4.1

turns out resiDual is prone to overflowing in fp16. add the scaling s…