Link. “The Google Brain team published a paper in 2017 called Attention is All You Need.
It introduced the now-famous Transformer architecture that you see to the left.
Everyone uses this now. It replaced ~everything in AI.
Google did absolutely nothing with this invention, opting for violent knee-jerking later, as per their usual M.O.”