ItsTheUltimateBob
ItsTheUltimateBob t1_j12goke wrote
Reply to comment by rjromero in [R] Nonparametric Masked Language Modeling - MetaAi 2022 - NPM - 500x fewer parameters than GPT-3 while outperforming it on zero-shot tasks by Singularian2501
That's a puny number of GPUs, too.
ItsTheUltimateBob t1_j16z2v4 wrote
Reply to comment by yaosio in [R] Nonparametric Masked Language Modeling - MetaAi 2022 - NPM - 500x fewer parameters than GPT-3 while outperforming it on zero-shot tasks by Singularian2501
Hopefully, they'll be beyond GPT-3.