Viewing a single comment thread. View all comments

robertjbrown t1_jeh148m wrote

Reply to comment by SatoriTWZ in How could AI actually cause the extinction of Homo sapiens? by BeNiceToYerMom

>We have no logical reason to believe that AI could go rogue

I think what Bing chat did shows that yes, we do have a logical reason to think that. And this is when it is run by companies (Microsoft and OpenAI) that really, really didn't want it doing things like that. Wait till an AI is run by some spammer or scammer the like who just doesn't care.

It could be as simple as someone giving it the goal of "increase my profits", and it finds a way to do it that disregards such things as "don't cause human misery" or the like.

4

SatoriTWZ t1_jeh3zdg wrote

but there, the danger lies in the human who controls the ai, not in the ai itself. the ai won't just be like "oh, you know what? i'll just not care about my directions and f* those humans up" but rather produce bad outcomes because of bad directions. but i think that ai is currently way too narrow to impose an existential threat and when it's general enough, it'll imo also be general enough to understand our directions correctly.

unless, of course, someone doesn't or wants it to cause damage and suffering, which is the whole point of my post.

1