I’m talking about the average American who is pushing 30%. Likewise, terribly unhealthy rail thin people are also limited by their body fat and need to make dietary changes.

Definitely also starts in the kitchen. You’re pretty hard limited on your ability to get more fit by the amount of fat on your body

Depends if people are investing money to make an AI related to that field but yeah that is the case

Right now is that time. Time and cost are on a sliding scale with ML. The more money you commit, the faster you can train AI. As it is, an AI can be finetuned on basically the entirety of the worlds knowledge of a specific subject in a month with (relatively) significant monetary investment

Idk if you know this but Microsoft basically owns OpenAI (ChatGPT / GPT3) already and has for a while

Well not necessarily though. This could be accomplished in 50 years without killing anyone. Demographic transition models only have relevance with respect to labor, but if the majority of labor was automated, it wouldn’t matter if everyone only had 1 kid.

What the fuck? No. I hope this technology never comes to fruition

Heeeey you guys should try bringing down the price of a mid tier mobo from $270

Not right now it won’t. We already know of ways to improve AI, but we don’t have data to allow an AI to improve itself. The only way for that would be generative design, which is by nature very wasteful and slow. Once it gets to a certain point yes, but as of right now we are far (relatively) from that

It is I promise. We have barely broken the surface of what AI can do with human designs. Right now the main limitations are compute power and data. Any explorations into alternative architectures and whatnot come with a massive opportunity cost because of these.

OpenAI alone has probably spent a billion on compute up to now. Insanity

I don’t think you guys understand, but every single week we’re improving leaps and bounds with minor tweaks and modifications to existing architecture. It would be extremely inefficient to allow the AI to try and improve itself when we have almost guaranteed improvement by humans that is only limited by how much GPU we can muster

Just out of curiosity, what is your education on the subject? I find it kind of strange or I guess inconsistent that you’re talking about multimodal LLMs and their necessity, but don’t know about OPT, InstructGPT, or why an Instruct model would be better than a predictive model

Haha, AWS actually just released one of these 2 days ago that’s waaaaay smaller but actually outperforms GPT-3 on reasoning tasks.

Here is the link: https://arxiv.org/abs/2302.00923

What exactly don’t you understand?

Following instructions makes it better because these models are by nature predictive. They don’t understand what you are saying, and are created to predict the next text after the input. By nature, the models basically have an implicit prompt that says “what follows this input:”. This is much less useful than following instructions, because in the real world, there is less money/productivity to be gained by predicting the next text sequence, and more to be gained by completing tasks that you ask it to.

InstructGPT is GPT-3 fine tuned to follow instructions, and is now the flagship GPT3, and the newest davinci model is instructGPT. ChatGPT is based on instructGPT and further fine tuned for dialog.

Not exactly but close. ChatGPT is instructGPT fine tuned for dialog. You could make your own version, but it would be pretty expensive

Like 6 months ago or so. They have also announced plans to open source the “instruct” model for OPT-30B and 175B I think in the next 2 months

https://opt.alpa.ai

Meta has open sourced copies of GPT-3 that are up to 175B

No it’s too late lol. It’s advanced to the point where very accurate 3d models can be made from 2 pictures. Look up NVIDIA NERF

Definitely an S curve still. Looking back at progress, it has been very, very slow until now. Basically the invention of the transformer changed everything

Google definitely does. Chat GPT is based off of GPT3-175B, and google has put out several models that outperform it. Like 4 or 5 I think and each of those significantly outperforms it’s predecessor

Locally will not cut it unless you have a high performance computer with lab grade GPUs for inference. The reason the AI models are so expensive to use is because they are actually pretty expensive to run. They are running probably 2 parallel versions of the model on a single a100, and have likely duplicated this architecture 10,000 times. And an a100 is 10 grand used, 20 grand new. You can also rent them out for about $2 per minute.

OpenAI is not going to close shop any time soon. Not sure if you know this, but Microsoft has been making huge investments into them, and has licensing rights to the GPT models. So Microsoft is pretty much the one who is serving the APIs, and they are right now looking into making another 10-billion-dollar investment into OpenAI.

Bullet to my brain

Nah bro she’s is extremely hot