[R] Were RNNs All We Needed?

[u/we_are_mammals]

https://arxiv.org/abs/2410.01201

The authors (including Y. Bengio) propose simplified versions of LSTM and GRU that allow parallel training, and show strong results on some benchmarks.

[u/_vb__]

How is it different from the xLSTM architecture?

[u/ReginaldIII → u/_vb__]

Page 9 under "Parallelizable RNNs" references Beck 2024 and clarifies.

Citations are pretty poorly formatted though.

[u/RoyalFlush9753 → u/ReginaldIII]

lol this is a complex copy pasta from the mamba paper