Submitted by OldWorldRevival t3_zo9v5x in singularity
The singularity is inevitable. If I convinced everyone here that we actually have to proceed with extreme caution and flesh out the dangers and solve the problems now - we would not delay the singularity by any meaningful amount.
But, we could totally dramatically improve the odds that its outcome is positive.
Ethics issues:
- People scraping copyrighted works on the internet.
- Privacy.
- AI being used to abuse power, especially in that technology has historically resulted in increased social stratification, not less.
- Assuming that the control problem isn't an existential threat to humanity.
- Assuming that merging mind with machines isn't going to result in a literal mind-control scenario, specifically with respect to point 3. Artificial superintelligence will be able to robustly alter your thought patterns, no problem. I.e. we might see a scenario along the lines of 3, where the transhumanist types do significantly augment their capabilities by physically interfacing their brains with these machines - and the intelligence boost that such a merger will confer will be enormous.
Like, everyone seems to want Star Trek, but they don't seem to ask whether we're building The Enterprise or we're building The Borg.
And worse, when you talk about ethics issues, people seem to shrug their shoulders and call it inevitable progress and "what can you do?" as if AI can't be developed in an ethical way. Failure to act ethically about "small" things like data use, permissions, etc. is not good in the age of approaching AGI is extremely worrisome.
Just assume that no matter how hard anyone opposes the progress of AI, that it will more or less continue on at the same rate. So, instead of being defensive about critiques to AI use, you should actually welcome criticism, because every step that someone else takes to ensure that this goes right is literally work someone else is doing for you to ensure your survival, and your future ethical treatment when these tools are more powerful.
Wassux t1_j0lnipt wrote
Then say, what can we do?
Ofcourse you can do it in an ethical way, but how are you going to stop china and North Korea? Please give a detailed explanation with steps on how we will do that from our homes.