bluehands

bluehands t1_ja9ka72 wrote

Sure thing.

Are you familiar with I Have No Mouth, and I Must Scream?

Rouge ASI could kill us all but a terrible person with an oracle ASI could make a factual, literal - as in flesh, blood & fire - hell on earth. Make people live forever in pain & suffering, tortured into madness and then restored to a previous state, ready to be tortured again.

A rouge ASI that wants us all dead isn't likely to care about humanity at all, we are just a misplace anthill. But we all know terrible people in our lives and the worst person you know is a saint next the worst people in power.

Tldr: we are going to create a genie. In the halls of power there are many Jafars and few Aladdins.

5

bluehands t1_ja8s20c wrote

People worry about ASI getting free but for me an obviously worse option is ASI being under the exclusive control of one of the oligarchs that run the world.

Literally think of whomever you consider to be the worst politician or ceo, then picture them having an oracle.

An unchained ASI is going to be so much better, regardless of if it likes us or not.

14

bluehands t1_j5ij5zx wrote

Fun fact:

I believe that humans are the only primate (and one of the few mammals) with completely white sclera (the white part of our eyes). This is almost certainly so that we can see where other people are looking.

This reminds me of a filter that makes you smile all the time - it could have a use but feels like there would need to be a bunch of supporting technology to being really useful.

0