Viewing a single comment thread. View all comments

Agreeable_Bid7037 t1_j9720op wrote

Reply to comment by IluvBsissa in What’s up with DeepMind? by BobbyWOWO

Its likely DeepMind is ahead with Language models and is simply not saying anything.

24

Aggravating-Act-1092 t1_j97jrcu wrote

Yeah this. It seems unlikely that DeepMind is behind OAI from a science perspective. OAI has done more/better to monetise LLMs but between Sparrow, Chincilla, Gato and Flamingo DeepMind definitely appears to have a good grasp.

As mentioned already, Demis said they would be cutting back on publications, what we are seeing is just that.

13

Superschlenz t1_j98leen wrote

>It seems unlikely that DeepMind is behind OAI from a science perspective

So it seems unlikely that Alphabet is not just pouring another $10B into DeepMind as Microsoft did with OpenAI?

Hahaha, just kidding. The people at DeepMind are so much more intelligent than the people at OpenAI, they can run all the new models perfectly inside their heads and don't need massive compute to verify and fix their buggy ideas (or hire a load of paid workers for RLHF).

−1

Aggravating-Act-1092 t1_j99j61t wrote

Huh? Of course Google is pouring money into DeepMind, most likely in similar quantities to MS to OAI.

Where did you derive that statement from?

2

prodoosh t1_j9a3ruk wrote

Google is a publicly traded company with open balance sheets. You don’t have to speculate my man

2

Aggravating-Act-1092 t1_j9bk0x0 wrote

That’s a good point. There accounts for 2021 are here:

https://find-and-update.company-information.service.gov.uk/company/07386350/filing-history/MzM1NDYzODM1NmFkaXF6a2N4/document?format=pdf&download=0

That works out at just under 2 billion USD in 2021. Given their own and the industry trend we can probably assume 2022 is higher and 2023 will be higher still.

OAI gave no timeline over which their 10B injection will be spent over, but presumably more than 1 or 2 years. So these two are definitely in the same league.

2