Policy
Xi and Trump Agree Humans Must Control AI Military Decisions
U.S. Treasury Secretary confirms consensus reached at APEC summit that autonomous systems should not make major combat choices.
Key takeaways
- Xi Jinping and Donald Trump agreed humans must remain involved in all military AI decisions during APEC summit talks.
- Both leaders concurred that autonomous AI systems should not be permitted to make major military action decisions independently.
- U.S. Treasury Secretary Scott Bessent characterized the consensus as a breakthrough in bilateral discussions.
- The agreement establishes shared principles on military AI governance despite ongoing U.S.-China strategic competition.
- Trump refers to artificial intelligence as "superintelligence" or SI in policy discussions.
Agreement Reached on Military AI Guardrails
Chinese President Xi Jinping and U.S. President Donald Trump reached a significant consensus on artificial intelligence during their meeting at the Asia-Pacific Economic Cooperation summit: humans must remain in control of military decisions involving AI systems.
U.S. Treasury Secretary Scott Bessent disclosed the agreement in an interview with CNBC, calling it a breakthrough from the bilateral discussions. According to Bessent, both leaders concurred that "humans should always be involved in any military decisions that SI makes, and that SI should not be allowed to be autonomous for major military actions." Trump uses the term "superintelligence" or SI when referring to artificial intelligence.
Why It Matters
This marks a rare area of U.S.-China alignment on AI governance at a time when both nations are racing to develop advanced military capabilities. The agreement establishes a shared principle that could shape international norms around autonomous weapons systems and prevent scenarios where AI systems independently authorize lethal force. For defense contractors and AI developers working with military applications, this signals that human oversight requirements will likely persist even as automation capabilities advance.
Implications for Military AI Development
The consensus addresses growing concerns about autonomous weapons systems and the risks of removing human judgment from critical military operations. While both countries continue to invest heavily in AI-powered defense technologies, this agreement suggests they recognize the need for guardrails on fully autonomous decision-making in combat scenarios.
The framework leaves room for AI to support military operations through intelligence analysis, logistics optimization, and tactical recommendations, but maintains that final authorization for major actions must come from human commanders. This approach attempts to balance the operational advantages of AI systems with the ethical and strategic risks of delegating life-and-death decisions to machines.
The timing of this agreement is notable given ongoing tensions between Washington and Beijing on technology competition, trade policy, and regional security issues. Finding common ground on AI military applications could provide a foundation for broader cooperation on AI safety and governance, even as strategic rivalry continues in other domains.
Details of the agreement were first reported by the South China Morning Post, based on Bessent's remarks to CNBC following the APEC summit meeting.