Submitted by izumi3682 t3_xxelcu in Futurology
Few_Carpenter_9185 t1_irc67ed wrote
Reply to comment by bk15dcx in White House Releases Blueprint for Artificial Intelligence Bill of Rights by izumi3682
The good news:
The ever increasing expansion of what weak-AI can be applied to is going to severely blunt the need to chase after strong-AGI that's self aware, and possesses other metacognitive traits. Such as being able to set its own goals, or modify itself in ways not intended or predicted. Which would be very very bad if it was malicious, or even just indifferent to human life.
That even includes eventual 100% mimicry of self awareness, emotional engagement, and interaction. But despite its sophistication, it only cares as much as your Reddit app does if you don't use it, or delete/erase it. Which is none at all. Using "cares" is misleading, because it does not have any ability that rises to that level.
The bad news:
Strong-AGI is not needed to have bad or unpredictable outcomes for humans. Either in how we use them, or how they work. Social media algorithms often don't even rise to weak-AI levels but already seem to be having massive effects on society, culture, and politics. And on individual cognition, emotions, and mental heath. And presumably that's while attempting to balance efficiency, enjoyment, and profitability. Deliberately using weak-AI to control people or manipulate them could be terrifying.
More bad news:
Even if weak-AI does most or all of what humans want, even destructive and lethal things, like military applications... and it removes the economic, power, or competitive incentives to develop strong-AGI...
Some assholes somewhere are going to try anyway, if only to see if they can.
And if strong-AGI is possible, the entry barriers to getting the equipment needed are rather low, especially as compared to nuclear weapons, or even dangerous genetically engineered diseases. And even if there's national laws and international agreements to prevent attempting it, or put various protocols or safeguards in place, they're probably irrelevant.
People might envision a James Bond villains lair, or even just some nondescript office building for such a project. In reality, it could easily be people working from home, a coffee shop, even sitting on a beach in different countries around the world. And the core computer systems are virtual servers distributed around the world, running redundantly and mirrored, mixed in with the systems of other websites, governments, businesses, and schools etc.
Viewing a single comment thread. View all comments