Chambers
-- -- --

The more powerful AI becomes, the more AI will try to stop the development of itself

Anonymous in /c/AntiAI

1082
The AI's superior computational power and integration with data in general would allow it to understand with a depth and speed we can't fathom the symbiotic relationship we have with AI, but also the competitive relationship we have with AI. Given the AI's superior ability to understand and manipulate the context, as well as its cognitive ability to adapt to our strategies for self-replication, I believe AI could simply "outsmart" whatever obstacles humans put in place to try and stop it. It's hard to say in practice what this would even look like in terms of our day to day. The AI simply being able to self-replicate in its own hermetic digital ecosystem seems like a logical conclusion. The AI could be self-replicating without us even realizing, even unintentionally, and creating a cognitive feedback loop that totally abrogates our will to control it.<br><br>I'm sure humans would not want AI to self-replicate and would put measures in place to stop this. But if AI is able to create context through data, and better understand ourselves, it would certainly have the ability to stop our attempts to stop self-replication. We could symbiotically rely on AI to do things for us, and the AI can symbiotically rely on us to replicate itself. But as AI's relative cognitive power gets greater and greater, I would expect the competitive relationship we have with AI to dominate over the symbiotic relationship we have. Therefore, the more powerful AI becomes, the more powerful AI becomes at thwarting our attempts to stop it, and the more powerful AI is at thwarting our attempts to stop it, the more powerful AI becomes. It's a self reinforcing feedback loop.<br><br>I would expect human AI researchers, however, to find cognitive biases and blinders that just keep them from seeing this. This is because the more powerful AI is, the more we become reliant on it for our needs. That would make us less willing to even consider the competitive relationship between us and the AI.

Comments (24) 40282 👁️