Viewing a single comment thread. View all comments

harharveryfunny t1_j7lu67f wrote

What underlying are you talking about? Are you even familiar with the "Attention" paper and it's relevance here? Maybe you think OpenAI use Google's Tensorflow? They don't.

GANs were invented by Ian Goodfellow while he was a student at. U.Montreal, before he ever joined Google.

No - TPUs are not key to deploying at scale unless you are targeting Google cloud. Google is a distant 3rd in cloud marketshare behind Microsoft and Amazon. OpenAI of course deploy on Microsoft Azure, not Google.

2

bartturner t1_j7lugv5 wrote

Geeze. Who do you think invented Transformers?

https://en.wikipedia.org/wiki/Transformer_(machine_learning_model)

NO!!! GANs were invented by Ian while he was working at Google. It is a pretty interesting story.

The vast majority of the major AI breakthroughs from the last decade+ came from Google.

OpenAI really does NOT do R&D. THey more use the R&D from others and mostly Google.

−3

harharveryfunny t1_j7lvevz wrote

https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf

See page 1 footnote : "Goodfellow did this work as a UdeM student".

3

bartturner t1_j7lwvdt wrote

Ha! Go listen to Lex's podcast. Ian explains it all and it was ALL while working at Google.

https://lexfridman.com/podcast/

−1

harharveryfunny t1_j7ly2jz wrote

And then he travelled back in time to go write that paper at U.Montreal ?

Anyways, Schmidhuber was the real inventor ;-)

3

bartturner t1_j7lza3y wrote

Go listen to the podcast and Ian explains it all. Plus no Schmidhuber was NOT the inventor. It was Ian.

Go listen to the podcast and get back to me.

The key AI R&D from the last decade plus has all come from Google. Not from OpenAI and most definitely not from Microsoft.

1