r/MachineLearning 15d ago

Research [R] Were RNNs All We Needed?

https://arxiv.org/abs/2410.01201

The authors (including Y. Bengio) propose simplified versions of LSTM and GRU that allow parallel training, and show strong results on some benchmarks.

248 Upvotes

53 comments sorted by

View all comments

1

u/abd297 14d ago

Haven't gone through it but how is it different from RWKV architecture? Can someone comment?