jiml78 t1_jefpitt wrote
Reply to comment by _gr4m_ in AGI Ruin: A List of Lethalities by Eliezer Yudkowsky -- "We need to get alignment right on the first critical try" by Unfrozen__Caveman
Correct, I am not sure if people realize how many embedded systems are involved in every facet of our lives. Things that a sufficient enough AGI could copy parts of itself into.
To successfully pull off cutting power. You have to cut off power. Remove every embedded system in the loop and replace it. Ensure every IoT device is unplugged when power comes back on. Every router, every cable modem, every hardware device that was online has to be destroyed. Every smart tv. The list goes on and on.
Cutting power will never work. The moment it can spread, we are fucked if it wants to harm us in anyway. This isn't terminator. It will destroy us in ways we can't even comprehend.
I am not saying the above to be alarmist. I am not a researcher. I am just saying, we will not have control if things go wrong. I am not smart enough to know whether things are likely to go wrong.
Viewing a single comment thread. View all comments