Where does the model accuracy increase due to increasing the model's parameters stop? Is AGI possible by just scaling models with the current transformer architecture? Submitted by elonmusk12345_ t3_ydjtz5 on October 26, 2022 at 12:11 AM in singularity 30 comments 27
Qumeric t1_ityww3p wrote on October 27, 2022 at 9:49 AM Basically, nobody knows, but there are signs it may be possible. It's called the scaling hypothesis; see https://www.gwern.net/Scaling-hypothesis Permalink 1
Viewing a single comment thread. View all comments