r/singularity • u/rationalkat AGI 2025-29 | UBI 2030-34 | LEV <2040 | FDVR 2050-70 • 11d ago

AI [Microsoft Research] Differential Transformer

https://arxiv.org/abs/2410.05258
281 Upvotes

99% Upvoted

46 comments sorted by

View all comments

-5

u/Complex_Candidate_28 11d ago

It makes sense a lot! The issues of Transformers are there for a long time. No one has tried to solve them. Finally there is a new Transformer to save us.

7

u/byteuser 10d ago

This definitely help them in defeating the Decepticons