Jq4000

Jq4000 t1_irbvo5v wrote

I think you outline a possible outcome. There's also the possibility that strong AI could be cracked in a way where the AI doesn't have a "grow at all costs" imperative that puts it on a ballistic trajectory of growth.

There's also the possibility that strong AI comes online in tandem with humans developing neural nets, in such a way that humans aren't left behind by an AI going asymptotic.

I agree with Kurzweil's thesis that we'll likely be facing AIs that pass the Turing Test by 2030. The point where things get serious for me is when machines pass Turing tests in perpetuity rather than for a few hours. That's the point where we may be dealing with more than our equals.

I'm not ready to commit that the world beyond 2030 is a black haze of singularity just yet. What I will say is that if we have machines passing the Turing test at that point then we should be buckling up for an eventful set of decades to follow.

2