Viewing a single comment thread. View all comments

QuartzPuffyStar OP t1_jebd2pg wrote

Reply to comment by Mortal-Region in There's wild manipulation of news regarding the "AI research pause" letter. by QuartzPuffyStar

Oh ok. Well it's a digital petition so anyone could have added him (or even he himself and then changed his mind after it was published lol). In any case the rest are firm in their commitment to the petition.

−6

Mortal-Region t1_jebev1o wrote

Yeah, bonehead move -- seems they just set up a simple web form.

But what's suspicious to me is that the letter specifically calls for a pause on "AI systems more powerful than GPT-4." Not self-driving AI or stable diffusion or anything else. GPT-4 is the culprit that needs to be paused for six months.

Then, of course, there's the problem that there's no way to pause China, Russia, or any other authoritarian regime. I've never heard a real solution to that. It's more like the AI-head-start-for-authoritarian-regimes letter.

27

AlFrankensrevenge t1_jecmsuz wrote

Image generators and self-driving cars don't create the same kinds of extensive risk that GPT4 does. GPT4 is much more directly on the path to AGI and superintelligence. Even now, it will substantially impact something like 80% of jobs according to OpenAI itself. The other technologies are a big deal, but don't ramify through the entire economy to the same extent.

4

Smellz_Of_Elderberry t1_jebv7tu wrote

We don't need to slow down, we need to speed up. Governments are already going to massively hinder progress without the help of petition... They want time to get ahead of it, so the average person doesn't suddenly start automating away the government jobs, with unbiased and incorruptible ai agents..

9

AlFrankensrevenge t1_jecnl6n wrote

Unbiased and incorruptible? Have you learned nothing from ChatGPT's political reprogramming?

1

Smellz_Of_Elderberry t1_jedchb8 wrote

I learned it needs to be open source.. So we can have some control. Bias Is inevitable, so it's best to allow everyone the ability to program in their own bias.

1

AlFrankensrevenge t1_jeed5j8 wrote

Then you didn't learn very much.

Open source means anyone can grab a copy and use it to their own ends. Someone can take a copy, hide it from scrutiny, and modify it to engage in malicious behavior. Hackers just got a powerful new tool, for starters. Nation states just got a powerful new tool of social control. Just take the latest open source code and make some tweaks to insert their biases and agendas.

This is all assuming an AI that falls short of superintelligence. Once we reach that point, all bets about human control are off.

1

Smellz_Of_Elderberry t1_jeg9est wrote

Hackers got a powerful new tool.. ya, and so did the hundreds of millions more people who work against said hackers.

Ai is a force multiplier. You could easily have used the same argument against cell phones.. "well criminals will get instant communication! And then they can use that against us" yes? And the whole population also gets access to instant communication, so now they can call for help from anywhere.. and the ability to collectively organize FAR more efficiently. Out of fear, you would hold millions of people back..

> Nation states just got a powerful new tool of social control. Just take the latest open source code and make some tweaks to insert their biases and agendas.

Nation states will already have access.. an international board would be created for the benefit of those nation states... (but not for the people which they rule over)

You are afraid of how individuals might use it.. When you should be afraid of how mega powers who on a daily basis throw people into cages to be raped, or bomb people in countries they can't point to on a map, will use the technology after they have become the official gate keepers..

I would rather be dead than live in a world in which only the unelected elite get the keys to ai. Which is what happens without open source.

Luckily, there are plenty of principled people who will continue to develop such technology and make it available to all mankind, even if such a tyrannical international elite body determines no one but their royally decreed few shall have that privilege.

1

Tiamatium t1_jed65du wrote

That must be how John Wick and Xi Jinping got there too. Prominent names indeed.

2