Comments

You must log in or register to comment.

3deal t1_j9wwq0h wrote

And it is how the humanity extinct.

−11

californiarepublik t1_j9xcn7v wrote

What could go wrong?

FWIW this is literally one of Yudkowsky’s scenarios for how AI could end us.

−2

astrologicrat t1_j9xs9ff wrote

Don't put too much stock in Yudkowsky's hallucinations. He has no understanding of biology and no unique talent for predicting the outcome of AI development. Any time he talks about the subject, it's a Rube Goldberg machine of fantasies.

The reality is that once a computer hits AGI that's sufficiently more intelligent than humans, there is basically an uncountable number of ways it can end humanity. Yudkowsky likes to bloviate about a few hand-picked bizarre examples so that people remember him when they discuss AGI.

Guess it's working.

20

CowBelleh t1_j9xxlo7 wrote

Would be cool to somehow crispr edit our brains to have > genius level intelligence

1

Scarlet_pot2 t1_j9xxvx5 wrote

Maybe we could use AI in the future to make life that could survive in other places in the solar system. Mists of Jupiter, methane seas of titan, dusty lands of mars.

7

ActuatorMaterial2846 t1_j9yauge wrote

Yeah, I think people took that comment about 'instantly killing us by releasing a poison in the atmosphere' a bit too seriously. Maybe because it was so specific, idk.

But he does have a point that we should be concerned about an autonomous entity smarter than humans in all cognitive ability. An entity that has no known desire apart from a core function to improve and adapt to its environment.

Such an entity would most certainly begin competing with us for resources. So, his emphasis on alignment is correct, and he is probably not overstating the difficulty in achieving that.

Everything else he says is a bit too doomer with little to back it up.

5

darkness3322 t1_ja0es7p wrote

You really can't see the potencial of this technology? We're literally talking about becoming something more, something that will raise questions about whether we can still call ourselves homosapiens or whether we should already apply a new name to our new evolutionary state...

2

kfractal t1_ja1mfbi wrote

being able to simulate lots of these interacting with each other and the real world is still part of the problem. but a step toward better understanding nonetheless.

1