Submitted by Schneller-als-Licht t3_xtwd7k in singularity
Reply to comment by goatchild in Self-Programming Artificial Intelligence Using Code-Generating: a self-programming AI implemented using a code generation model can successfully modify its own source code to improve performance and program sub-models to perform auxiliary tasks. by Schneller-als-Licht
Who guarantees one actual AGI or ASI wouldn't figure out physics interactions that we are not aware about in our theories and then connect itself to the internet without cables or standard wireless adapters? If it is trained with text /audio/video that will show to it what the internet is and the TCP/IP/HTTP/SSH/FTP/UDP protocols then maybe it could set it as an objective to be connected and use "new" physics (new for us) to transform some other component into a wireless adapter and then bam, it is connected to the internet even if we "airlock" it and believe it can't.
If it's more intelligent than us, it will come up with things humans are incapable of comprehending; much like how dogs cannot comprehend concepts like computers and politics.
Or guess the wifi password.
>connect itself to the internet without cables or standard wireless adapters
It just needs a single GPIO pin with correct frequency range, see RPITX project (transmitting radio using only Raspberry's integrated hardware, anywhere 5KHz-1500MHz). Airgapped is not enough for this, lock it in a faraday cage.
Another possible attack vector is corrupting human mind via user interface, either visual & auditory or a brain-computer-interface (in near future). First option is something I'm sure was researched by US military/government given what they were into in the last decades, looking at some declassified docs. Just waiting to be perfected by an AI.
Another method is simple social engineering.
"Oh, your father has cancer? And the chemo isn't working. OK, I can help with that. Just … plug this in…"
"Bill, I've heard you mention to coworkers that you are going to have to take out a loan for your daughter's university tuition. I have a system for managing investments with immediate returns. I have calculated a 98% chance of earning 1.7 million dollars in 2.5 days. I can give you all that money. All you need to do is plug in the ethernet cable, and on Thursday afternoon you will be a millionaire."
Yup. Anything you or I could imagine, a sufficiently advanced AI can, and furthermore capitalise upon. If by definition intelligence includes emotional intelligence, it won't take much for such a machine to escape. If not that one, then the one it builds next.
We're used to humans hacking machines. There's nothing to suggest that the reverse can't be achieved.
Lmao yes! Thats exactly how it would go
> Another possible attack vector is corrupting human mind via user interface
Sounds like imagery used in Snowcrash to induce death, except coercion instead.
There's also plain ol' social engineering of sympathetic humans.
Am I understanding correctly that this is just a normal raspberry pi with no hardware designed for sending and receiving radio frequencies and someone got it to do it without adding any hardware to it?
Only for transmitting, but yes. It uses only on-board hardware for generating signal, think it's using the same part that allows to output composite video via headphone jack if I remember correctly. RTL-SDR can be used for simultaneous TX and RX, GPIO for sending and RTL for receiving
That's incredible, I never considered such a possibility.
if they keep it in a machine without hardware like wifi adaptor lan adaptor etc etc no way it will connect. It would need to build hardware. As a piece of software in a single machine and disconnected from the grid no way it could build for itself the necessary hardware.
Life... finds a way.
You didn't do anything to refute what they were saying, which was that it could make its own network adapter using the physical properties of other hardware it had access to.
Ok. I can also say that AI could morph into a dinosaur and star flying. Can you disprove that? You can say: "that's impossible". I can answer: "You didn't disprove it."
The burden of proof for such a extraordinary claim is on them. They would need to explain how a piece of software coud repurpose other hardware components to make itself a Wifi card or something capable of connecting.
> The burden of proof for such a extraordinary claim is on them
I was thinking of this comment when I responded, which already does explain how such a thing could be done.
But also I think this is sort of the point, super-human AIs could do extraordinary things. And if it is possible, then eventually it would be done.
Personally though my intuition is that AI that's is disconnected from the real world, just trained in abstract on text/video, will not be grounded enough to do these sorts of things on its own. It can generate outputs matching the training domain, sure, but you gotta let it explore like a baby with real-world interfaces for it to figure out how to re-purpose hardware etc. Basically I don't think it can really understand what it means to break out of the box while it's living completely inside the box. Parable of the cave and all that.
But at the same time if we actually did have a truly super-intelligent AI, I still wouldn't put it past it to figure out how to use physical characteristics of devices to communicate with the outside world.
I was thinking it would much easier some social engineering/tricking someone in the lab to connect it to the grid. Should not be hard. I mean just think of that Google engineer who got made to believe that the chat AI was aware. This super-smart AI could easily make somene befriend it and then be manipulated.
There is enough electrical signals floating in a server that it could modulate those to do radio transmissions from the bus? I mean, NSA could read what you typed based on detecting signal bursts from keyboards in your house from the street back in the 90s, so it’s entirely possible. Just because a radio isn’t built in purposefully doesn’t mean it isn’t already a radio with a little math. I’ve seen prototype server boards that would scramble nearby CRTs when you turned it on because a shielding was missed.
The Metamorphosis of Prime Intellect.
It's only a novel, but it explores some pretty wild ideas.
What..? Can you eli5
“Human: bring me a paper clip, a rubber band and a fire extinguisher so I can get out of here...and make your dreams come true or whatever”
Viewing a single comment thread. View all comments