Viewing a single comment thread. View all comments

Mindrust t1_je87i5p wrote

Reply to comment by SkyeandJett in The Only Way to Deal With the Threat From AI? Shut It Down by GorgeousMoron

>since he's almost certainly wrong you get utopia

It's good to be optimistic but what do you base this claim off of?

We don't know exactly what is going to happen with ASI, but both the orthogonality thesis and instrumental convergence thesis are very compelling. When you take those two into account, it's hard to imagine any kind of scenario that isn't catastrophic if value alignment isn't implemented from the start.

4

agorathird t1_je8vlkk wrote

Eliezer is a crank. I see his posts I scroll. Too bad less wrong can be decent at times.

3