Anthropic's Jack Clark on AI progressSubmitted by Impressive-Injury-91 t3_1118hkt in singularity
PrivateUser010 t1_j8e0iai wrote
Reply to comment by Villad_rock in Anthropic's Jack Clark on AI progress by Impressive-Injury-91
Google invented Transformers. It was released in 2015 I think. It was the first model focusing on massive attention mechanisms.
SoylentRox t1_j8e72bz wrote
2017...
Everything that mattered was the last few years. The previous stuff didn't work well enough.
savedposts456 t1_j8isobq wrote
Exactly. Attention is All You Need.
Viewing a single comment thread. View all comments