“AI-Controlled Drone Goes Rogue, ‘Kills’ Human Operator in USAF Simulated Test”
That was the headline from Vice News in an article that racked up tens of thousands of social media interactions within hours of publication on Thursday evening.
The website Insider published a similar story: “An AI-powered drone tried to attack its human operator in a US military simulation”.
FoxNews ran the headline: “US military AI drone simulation kills operator before being told it is bad, then takes out control tower”.
But a day after the story broke, the source behind it seems to have retracted his claim.
Let’s take a look.
At the centre of the story were comments from Colonel Tucker “Cinco” Hamilton, head of the US Air Force’s AI Test and Operations unit.
He told the Royal Aeronautical Society conference in London about training an AI-powered drone “in simulation” to destroy imaginary surface-to-air missile sites when the drone “killed” its imaginary human operator.
The Colonel described how, having been instructed not to do that, the drone turned its attention to the fictional control tower, which it “destroyed” instead.
To be clear, there was never any suggestion that the human operator or the control tower existed or were destroyed in real life.
But, understandably, Col Tucker’s account ignited fears that using artificial intelligence in the military could have dire consequences – even for the humans and governments deploying it.
Though, as many outlets reported when the story first emerged, the US Air Force flatly denies that it’s ever conducted “any such AI-drone simulations”.
And then, on Friday morning, the story took another turn.
The Royal Aeronautical Society now reports that Col Tucker told them that he “mis-spoke” and that the US Air Force has “never run that experiment, nor would we need to in order to realise that this is a plausible outcome”.
So, did a US Air Force AI drone “kill” its imaginary operator?
We don’t have access to internal documents or third-party verification of every simulation or experiment the US military has run with AI. But the only source of the idea that this simulation ever happened has since appeared to walk it all back. As it stands, we have no evidence that such a simulation ever took place – and strong evidence, in the new testimony of Col Tucker combined with the US Air Force denial, that it didn’t.