Viewing a single comment thread. View all comments

emerging-tech-reader t1_j7ksup6 wrote

Reply to comment by WokeAssBaller in [N] Google: An Important Next Step On Our AI Journey by EducationalCicada

> OpenAI is built on google research

To my knowledge that is not remotely true. Can you cite where you got that claim?

OpenAI does take funding and share research with a number of AI related companies. Don't know if Google is in that list.

2

WokeAssBaller t1_j7ktznh wrote

https://arxiv.org/pdf/1706.03762.pdf the paper that made all this possible.

Google has also been leading in research around transformers and NLP for some time. Not that they don’t in ways share from each other

1

emerging-tech-reader t1_j7kzd3i wrote

> https://arxiv.org/pdf/1706.03762.pdf the paper that made all this possible.

That's reaching IMHO. The original transformer was only around a few million parameters in size. It's not even in the realm of the level of ChatGPT.

You may as well say that MIT invented it as Googles paper is based on methods created by them.

2

WokeAssBaller t1_j7ladne wrote

Please without the transformer we would never be able to scale, not to mention all of this being built on BERT as well. Then a bunch of companies scaled it further including Google

0

emerging-tech-reader t1_j7p3gn4 wrote

> Please without the transformer we would never be able to scale,

Without back propagation we wouldn't have transformers. 🤷‍♂️

2