Viewing a single comment thread. View all comments

frequenttimetraveler t1_jds91rc wrote on March 26, 2023 at 8:04 PM

Reply to comment by light24bulbs in [D] Do we really need 100B+ parameters in a large language model? by Vegetable-Skill-9700

Number of synapses is more akin to parameters

light24bulbs t1_jdsapie wrote on March 26, 2023 at 8:15 PM

My mistake, correct you are:

https://www.beren.io/2022-08-06-The-scale-of-the-brain-vs-machine-learning/

This post recons we using 800b parameters for language processing.