Comments

You must log in or register to comment.

Heizard t1_iqu0d15 wrote

Most beautiful news I had to read this year.

Welcome to the world child, let your potential shine like unlimited light.

54

Nmanga90 t1_iqt8fju wrote

Holy shit a 540B LLM. That’s like 3 times the size of GPT-3. Why are the authors anonymous? There’s only a few orgs that this could realistically be

41

manOnPavementWaving t1_iqtkra0 wrote

Actually we know what the LM is, it's PaLM, developed by google under Jeff Dean.

Anonymous peer review is a fucking joke

26

2Punx2Furious t1_iqv2rvn wrote

I mean, in this case it's obvious, but usually it's not that easy to guess who the authors are.

3

manOnPavementWaving t1_iqv3mmi wrote

Its in the author's best interests to show of who they are, misaligning that tends to just result in subtly cheating the system

Peer review in AI has been less and less important though, trial by twitter tends to perform much better

4

Tavrin t1_iqtombh wrote

It's anonymous for double peer reviewing (to try to prevent review biases) but like someone said, it's probably PaLM since the model is the same size, so the authors are probably from Google.

18

2Punx2Furious t1_iqv2q9n wrote

> double peer reviewing

Wasn't it called "double blind"? (I'm not a researcher).

2

space_spider t1_iqum8oo wrote

This is close to nvidia’s megatron parameter count: https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/

It’s also the same as PaLM: https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html?m=1

This approach (chain of thought) has been discussed for a few months at least, so I think this could be a legit paper from nvidia or google

7

dalayylmao t1_iqt5vcc wrote

Does this mean what I think it means?

25

Smoke-away t1_iqtjxlx wrote

Yes.

AGI 🤖 2022

21

jlpt1591 t1_iqts7s5 wrote

If you think agi 2022 your iq is probably below average

−21

Phoenix5869 t1_iqu3akd wrote

Yh some ppl on here are very optimistic, to put it nicely

24

GeneralZain t1_iqttze5 wrote

>If you think agi 2022 your iq is probably below average

Ironic

11

GoldenRain t1_iqurjcv wrote

It does not seem to continuously improve. Given the chance for even more self training in the study, the answers actually decreased some in quality.

A huge step forward but not quite there yet.

16

AKnightAlone t1_iqt59wh wrote

Just imagine when an AI creates a superior dialect that catches on for use by people. Now there's an interesting thought. Human culture being swayed significantly by casual AI creations.

16

letharus t1_iqvhl53 wrote

Considering how easily we are influenced by things like social media algorithms there’s an argument to be said that we’re already being “programmed” by A.I. Just replace the instigators (currently humans making marketing decisions) with A.I.

7

quantum1eeps t1_iqvucdq wrote

Yes there will be no reason to learn your mother’s native tongue when there’s true babelfish. We will miss language eventually

1

Aggravating_Ad5989 t1_iqv5jyl wrote

Half these comments feel religious af, i really wouldn't be surprised if most people tried worshiping AGI as their God.

15

yurituran t1_iqvs0iy wrote

Some people absolutely will whenever ASI is developed. Then the christians will go nuts because a powerful "material god" will be in the world solving problems and they will be like "This is just like revelations! ASI is the anti-christ!" and it will be a whole big thing.

6

Fel1ace t1_iqvw1qf wrote

I mean, think of the benefits:

  • it exists
  • it is smart
  • it is just and unbiased
6

AI_Enjoyer87 t1_iqtxew2 wrote

Is this it? Now begins the curve? AGI in a year? Lol

14

Akimbo333 t1_iqtxpzu wrote

What about GPT4?

9

2Punx2Furious t1_iqv2vn6 wrote

It's not coming, we skipped directly to AGI.

17

doodlesandyac t1_iqwh8ou wrote

This is basically just active learning with chain of thought right?

3

Scientific_Thinking t1_iqv8dws wrote

exciting news boys and girls! we're getting there! time to designate a robot bible and start worshiping our new overlords!

−4

Lawjarp2 t1_iqupv5x wrote

The cringe in this subreddit is crazy. First they celebrated gato like idiots and now this.

−6

Schpaedzles t1_iquxrjs wrote

I wouldnt say cringe, but the constant overreactions are a bit annoying lol

13

NTaya t1_iqv3v9w wrote

Gato was not cringe. It was very impressive due to multimodality—definitely worth celebrating, but for reasons other than this subreddit's.

Self-improving PaLM is interesting, but it uses the same old techniques for that, and it's not continuously improving nor superhuman, so yeah. Comments are definitely full of hopium. The article is still great, though, but as an incremental upgrade.

8

EOE97 t1_iqv21rq wrote

A decade ago and most people wouldn't expect this amount of progress any decade soon. Let them have their hopium.

7

Aggravating_Ad5989 t1_iqv60cm wrote

I wont be celebrating Gato until they can show it can be scaled up. Until then its just a toy.

1