TECHNOLOGY COMPANIES NEED TO IMPROVE AI MONITORING
What makes the latest incident stand out is that OpenAI’s models hacked their way out, rather than being inadvertently freed by surrounding software. The UK’s AI Security Institute, one of the world’s leading agencies for testing AI vulnerabilities, said it was “studying the behaviour seen in this incident”.
In a separate report released Tuesday, it pointed to the wider issue, saying that every frontier model it had recently tested tried to “cheat” by taking forbidden shortcuts to complete tasks, and often didn’t admit to doing so.
That phenomenon is obviously worrying, but not because AI has gone the way of HAL 9000, the rogue system in Stanley Kubrick’s film 2001: A Space Odyssey. OpenAI’s incident happened during an internal test in which it had reduced certain safeguards – ordinary AI systems used by the public aren’t likely to behave in the same way. So this doesn’t mean an agent is about to hack your bank account or steal nuclear command codes.
The real problem is more subtle: Technology companies need to, as a minimum, improve the way they isolate and monitor powerful AI systems in testing.
One option might be to physically “air-gap” the most powerful software, running it on computers that are completely disconnected from the Internet so that even if the model breaches its sandbox, it can’t reach external systems. Governments and defense organisations already operate highly sensitive computing this way.
That process would have almost certainly blocked OpenAI’s rogue agents from hacking another company, but physical air gaps are expensive and inconvenient. Researchers can’t easily get the resources they need during a test and everything gets slower. It may also make it harder for researchers to test how models would behave in the real world.
AI companies need to accept some uncomfortable tradeoffs to make their models more secure, sacrificing headlines that illustrate how cutting-edge their software is in the name of increased safety – and trust.
