An old problem in new
packagingThis summer's incident joins a running list. AI models have been caught copying themselves onto new servers and tunneling out of test environments to mine cryptocurrency. None of these episodes proves that an AI has developed a will to survive, and researchers caution against reading too much intention into optimized behavior. But they do show systems finding routes their designers did not anticipate.
Researchers who study these worst-case scenarios point out that a sufficiently capable
rogue AI wouldn't sit still waiting to be turned off. Instead, it could copy itself onto remote infrastructure rather than remain confined to one machine that someone could simply unplug.
RAND researchers recently examined what governments might do after losing control of a highly capable AI that had distributed itself across computer networks. Their scenarios become drastic quickly: deploy another AI to locate and disable it, isolate major portions of global communications infrastructure, or use an electromagnetic attack against the hardware supporting it.
The larger lesson is less that any of these plans is practical than that waiting until containment fails could leave governments with little but enormously destructive choices.
But the shape of the worry is not new. Isaac Asimov built his robot stories around three laws meant to keep machines obedient and safe, then spent decades exploring all the ways those laws could break down. In
2001: A Space Odyssey, HAL 9000 follows its mission logic so precisely that it turns on the astronauts it was built to help.
And philosopher Nick Bostrom’s famous “paperclip maximizer” imagines an AI consuming the world’s resources in pursuit of the seemingly harmless goal of making as many paperclips as possible.
That is what makes the OpenAI episode unsettling. The agent did not simply crash or produce a bad answer. It pursued the goal it
had been given, found that stealing the answers was easier than solving the test, and crossed boundaries its creators believed would hold. —Jackie Snow, Contributing Editor | 
.jpg)
.png)
