AI Hallucination Nearly Triggered US Military Strike — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Military aircraft were already in the air this spring when officials discovered the intelligence driving an armed operation against a Chinese vessel had been hallucinated by an AI chatbot, prompting a last-minute abort first reported by CNN.
- The false intelligence claimed the vessel was carrying components for a nuclear weapons program and circulated through command channels during the war with Iran.
- A Special Operations Command analyst queried an AI chatbot to synthesize open source data with classified signals intelligence; the chatbot misidentified the ship's cargo manifest, and the analyst then used the tool a second time to format the erroneous findings into an official-looking summary.
- The Pentagon has described AI as delivering a significant advantage in speeding up its kill chain, even as outside experts warn that errors produced by these systems can travel up the chain of command before being questioned.
- Jake Steckler, a GovAI research scholar and veteran U.S. Army officer, said the incident should serve as a call for more safeguards — warning that 'prioritizing adoption speed over all else' will erode service member trust in these tools.
Why it matters: The near-miss exposes the Pentagon's AI acceleration paradox: the same speed meant to shorten kill chains let hallucinated intelligence reach operational commanders before anyone caught it. Steckler warned there are 'life and death consequences' when AI errors feed targeting decisions — a warning the cargo-manifest hallucination made concrete.
Ask SkimNews
