Viewing a single comment thread. View all comments

acutelychronicpanic t1_jdpbkul wrote

You don't need an AI to be smarter than humans in order to get an intelligence explosion. You just need an AI that's better at AI design. This might be much easier.

42

Fluglichkeiten t1_jdq2i5n wrote

Yeah, exactly this. It doesn’t necessarily need to be a general intelligence. The question then is; are any of the current AI models better than humans at the specific skills required to make AIs?

I don’t know the answer. I suspect not, but it feels like we’re not too far away. Current models seem to have achieved a kind of ‘creativity’ and can be linked with other systems to shore up their deficiencies (such as maths). Maybe if one of the larger models was trained specifically to work on AI design… although how would that look? Feed an LLM lots of academic papers paired with real world implementations?

I’d be interested to see what the big labs have cooking behind the scenes.

10

acutelychronicpanic t1_jdqrppa wrote

Probably not? At least not any public models I've heard of. If you had a model architecture design AI that was close to that good, you'd want to keep the secret sauce to yourself and use it to publish other research or develop products.

LLMs show absolutely huge potential for being a conductor or executive that coordinates smaller modules. The plug-ins coming to ChatGPT are the more traditional software version of this. How long until an LLM can determine it needs a specific kind of machine learning model to understand something and just cooks up and architecture and can choose appropriate data?

2

lehcarfugu t1_jds352j wrote

It seems like they are capped out by the data they receive, so by their nature they are going to be as smart as the collective human race, but not smarter. I think it's unlikely the singularity comes from this current approach.

1

DixonJames t1_jdqlhou wrote

yes. key to chat GPT is that it can't improve itself - the engineers need to release a new version. When we have an evolving AI, that's when we are really running fast.

2

acutelychronicpanic t1_jdquwei wrote

That sounds absolutely terrifying, please don't. We'd just be handing the reins off to chance and hoping.

2