Frumpagumpus t1_jef7kdl wrote
Reply to comment by burnt_umber_ciera in AGI Ruin: A List of Lethalities by Eliezer Yudkowsky -- "We need to get alignment right on the first critical try" by Unfrozen__Caveman
> Just look at how often sociopathy is rewarded in every world system.
It can be yes, cooperation is also rewarded.
It's an open question in my mind as intelligence increases what kind of incentive structures lie in wait for systems of superintelligent entities.
It is my suspicion that better cooperation will be rewarded more than the proverbial "defecting from prisoners dillemas", but I can't prove it to you mathematically or anything.
However if that is the case, and we live in such a hostile universe, why do we care exactly about continuing to live?
Viewing a single comment thread. View all comments