The US military came dangerously close to intercepting a Chinese vessel based on an intelligence report that was generated with the help of an AI chatbot and turned out to be entirely false, according to a CNN exclusive published Thursday.
The episode, described to CNN by four sources familiar with the matter, began earlier this spring — in the midst of the war with Iran — when a report circulated across the US military claiming that a Chinese ship in the Middle East was transporting components of a nuclear weapons program. The report immediately set off alarm bells, and the military swung into action with plans to intercept the vessel. For regular coverage of stories like this one, follow AI news as it develops.
Planes in the Air, Boarding Party Ready
According to two of CNN's sources, armed members of the US military were preparing to board the ship. Military planes were already in the air, one source said.
It was only just before the planned operation that officials dug deeper into the report — put together by a special operations command analyst — and discovered that it had been generated with the help of artificial intelligence, and that the chatbot the analyst had used had inaccurately identified the material the ship was carrying. CNN reported it was not able to learn what the misidentified cargo actually was.
One source described the report as "entirely false." It also, the source said, "almost started a war" — since any US operation against a Chinese vessel could have risked spiraling into an armed conflict between the two nations.
How the False Report Was Built
The analyst had queried a chatbot about intelligence reporting on the ship's manifest that originated with US Special Operations Command Pacific, based in Hawaii. CNN reported it was not clear whether the chatbot was a commercially available product or a US government tool.
The bot fused together open-source intelligence with secret signals intelligence in government holdings and reached its fateful conclusion about the material aboard the ship. The analyst then used AI a second time — to package the findings into a standard intelligence report, the kind trusted by military officials — and disseminated it across the system.
US Special Operations Command Pacific and the Pentagon did not respond to CNN's request for comment.
A Military Racing to Adopt AI
The near-miss lands at a moment when officials across the US military and intelligence community are pushing to weave AI into nearly every facet of their work — from analyzing huge volumes of raw intelligence and selecting targets for strikes, to mundane applications like budgeting, logistics, and supply chains.
In January, Defense Secretary Pete Hegseth released the department's "Artificial Intelligence Acceleration Strategy," intended to speed up the military's adoption of AI. "We will unleash experimentation, eliminate bureaucratic barriers, focus our investments and demonstrate the execution approach needed to ensure we lead in military AI," Hegseth said in a speech announcing the strategy.
The strategy explicitly calls for democratizing access, ordering the department to put "America's world-leading AI models directly in the hands of our three million civilian and military personnel, at all classification levels."
No Single Set of Rules
But the effort is decentralized, multiple US officials told CNN, with different parts of the government using different tools under different orders and safety standards. There is no one set of standards for how the US verifies information generated by these tools, and the reliability of the various systems varies widely.
"The internal tools are mostly just copies of the commercial stuff wearing lipstick," a former senior US official familiar with the AI systems used by military and intelligence analysts told CNN.
AI Targeting Is 'Ramping Up' With Little Guidance
Sources said the military is rapidly turning to AI to help with targeting — an area that carries the obvious risk of fatal mistakes. "AI in targeting is definitely something that is ramping up and there is no real guidance for how having a human in the loop will prevent civilian casualties or fratricide," another source familiar with the military's current policies told CNN.
Analysts have long warned that AI could contribute to a catastrophic miscalculation if nation states rely on poor or corrupted data — precisely the kind of miscalculation that could have led the United States to fire on a Chinese ship based on inaccurate information.
According to CNN, the kind of hallucination behind the false ship report has not been an isolated incident across the intelligence community since these tools began proliferating through government.
'AI Allows You to Get to a Bad Idea Faster'
For weeks, Washington policymakers have been intensely debating AI following a series of dire warnings from Silicon Valley about the possibility that AI could break free of human constraints. But the Chinese ship episode underscores a different and more immediate risk: human beings making disastrous decisions based on inaccurate or misleading information generated by AI systems.
Several sources told CNN that younger analysts in particular — natives of these tools — are more likely to trust them uncritically, and that AI has intensified pressure on analysts to produce and disseminate intelligence faster, opening the door for mistakes.
"AI allows you to get to a bad idea faster," one of the sources said.
The episode is likely to fuel an already heated debate over how fast the U.S. military should fold AI into its most sensitive workflows, and what verification steps should be mandatory before AI-assisted reporting can move troops, aircraft, and armed personnel toward a potential combat operation. For now, the details suggest the safeguards that exist are a patchwork — and that in this case, the difference between a routine intelligence report and an international incident came down to officials who happened to double-check.
Stay Ahead of AI
For more reporting on AI policy, national security, and the models shaping both, read more AI news.
