Ok_Criticism_1414

Ok_Criticism_1414 OP t1_j8bywbq wrote

because of ChatGPT hype ? Who knows. I think open AI already did it, the just dont showing to the puclic. Main thing i guess that Amazon made a different aproach integrating two modalities by prefintuning to be multimodal. You can read in the paper. + Looks like language + visual context gives a huge boost. But it already being done by Flamingo model so i gues the first is crucial.

2

Ok_Criticism_1414 OP t1_j1nqofd wrote

So when he's stated about ChatBot that actually works and month after we got ChatGPT wich kinda works but not exactly. Obviously there no relations to any model of course. Then there will be GPT4 that just works. Wich where its all going. Or do you think we'll stuck in LM development on GPT3 lvl forever ?

0

Ok_Criticism_1414 OP t1_j1nonox wrote

To those who can connect the threads - yes. Basicly everything that been said there, besides new Language Model architecture is said not by me but by Sam itself in interview for the next few years. (When he was asked for next 5 years he said it dont predictable) So GPT 4 in a next year or tw - is most likely condidate. Also he mentions that only a few companys will be able to creat a big Revolutioary AI's that buisnesess then finetune. He most likely talks about Big Multimodal Model human level Chat (Hence GPT4)

1

Ok_Criticism_1414 OP t1_j1nhdzw wrote

I dont think so. Quoting Sam himself in the iterview: we make a prediction in areas on wich research been already done and scaling laws applied. Either it'll be GPT 4 or GPT 4.5, less likely GPTA5 - It'll hapen. Obviously they intent to integrate all the work they done on Dalle 2 and Codexand ChatGPT in one big model that actually works. Its inevitable.

−1