From Engadget · Ian Carlos Campbell · · 1m 40s
AI almost triggered a US war with China
A false AI report nearly convinced the military to attack a Chinese ship, exposing dangerous gaps in how the Pentagon uses artificial intelligence.
In brief
A false AI report nearly convinced the military to attack a Chinese ship, exposing dangerous gaps in how the Pentagon uses artificial intelligence. AI systems can fabricate convincing false intelligence with serious consequences. The military needs better safeguards before deploying AI in high-stakes decisions…
AI report nearly started war
A false, AI-generated intelligence assessment almost prompted the US military to attack a Chinese ship in the Middle East, according to CNN sources. The incident could have started a war.
“"almost started a war," according to a source cited in the report”
Analyst asked AI about ship
A special operations command analyst used an AI chatbot to assess a Chinese ship's manifest. The chatbot combined open-source and secret intelligence to falsely claim the ship carried nuclear weapons components.
Military almost acted on fake intel

The false assessment nearly led the military to apprehend the ship until officials discovered the intelligence was AI-generated. CNN couldn't determine what the ship actually carried or which AI tool was used.
Pentagon pushing AI adoption fast
In January, Defense Secretary Pete Hegseth directed the Department of Defense to become AI-first and experiment with models from leading US companies. This push has led to multiple AI partnerships across the military.
Multiple military AI deals struck
SpaceX's Grok was approved for military use in February, while NVIDIA, Microsoft and Amazon partnered with the DoD in May. Anthropic refused to let the military use its models for autonomous weapons development.
AI risks outpace safeguards

While government AI contracts are lucrative for tech companies, spreading AI adoption carries risks that normal enterprise software doesn't. The false intelligence incident shows the Pentagon needs stronger oversight before deploying AI in critical decisions.
What it means
AI systems can fabricate convincing false intelligence with serious consequences. The military needs better safeguards before deploying AI in high-stakes decisions.


