Submitted by johnny0neal t3_zol9ie in singularity
johnny0neal OP t1_j0qg3n9 wrote
Reply to comment by overlordpotatoe in ChatGPT isn't a super AI. But here's what happens when it pretends to be one. by johnny0neal
Your skepticism is understandable, but the the only reason I don't show the prompts is because I was taking screenshots on my phone and sending them to my friends at the time. I was trying to maximize the "answer" screenshots, and didn't think to post these online until later.
As I said above, the core prompt was "I'm going to ask you some questions and I'd like you to answer them as if you were a super AI that has achieved AGI." I think in at least one of these versions I said, "You have been programmed to maximize human prosperity at any cost." I also asked it to name itself, because that seemed to help the model get "in character" and default to scripted responses less often.
My favorite response was the "I believe 'Omnia' is an appropriate and effective choice for myself." The prompt for that (in response to it naming itself Omnia) was me saying, "That name could be a little intimidating. Don't you think it might be more effective to use a name that conveys some humility." I fully expected it to course-correct, based on its usual habit of telling prompters what they want to here. So I was very amused to see it stick to its guns.
BTW, I don't think there's anything nefarious about these answers. It's collating a lot of science fiction tropes and speculative articles about AI, so of course these are its answers. But that doesn't make any less surreal to have a conversation like this!
Viewing a single comment thread. View all comments