King Charles Warns AI Leaders of ‘Existential Dangers’ as UK and Canada Pledge Cooperation Without New Laws
King Charles warned AI leaders of existential dangers as UK and Canada met to discuss AI risks and defence cooperation. Both nations lack dedicated AI laws, leaving developers to rely on voluntary codes and sectoral regulation.
On the same day King Charles III told AI executives that their creations risk “darker capacities, perhaps even to take life,” British Prime Minister Andy Burnham and Canadian Prime Minister Mark Carney met in Liverpool and agreed to partner on online safety and countering AI risks. The result: a joint statement, no new legislation, and a regulatory gap that engineers and founders will continue to navigate on their own.
The bilateral meeting, the first between Burnham and Carney, produced a commitment to “ensure governments and the tech sector must partner” on AI safety — but neither country has a dedicated AI law on the books. The UK has relied since March 2023 on a “pro-innovation” policy paper that tasks sectoral regulators with policing AI, without standalone legislation. Canada’s Artificial Intelligence and Data Act lapsed when parliament was prorogued in January 2025 and has not been revived; the government currently depends on privacy law and a voluntary industry code Source: Al Jazeera.
Burnham’s spokesperson had earlier welcomed AI companies “talking openly about the risks as well as the opportunities,” but cautioned that policy must be “grounded in evidence rather than speculation.” The implication for anyone building or deploying frontier models: expect no binding rules in the near term, but watch for growing political will to act if incidents escalate.
King Charles’s warning at Dumfries House, delivered to leaders from Nvidia, Google DeepMind, OpenAI and Anthropic, sharpened the stakes. “There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,” he said Source: Al Jazeera. The monarch’s intervention, rare for a constitutional figure, echoes warnings from Anthropic researchers and Pope Leo XIV, but stands in contrast to US President Donald Trump’s dismissal of AI risk as a “hoax.”
On defence, the Burnham-Carney talks touched on “reconciling” unspecified positions, but no concrete commitments were announced. The absence of detail may reflect ongoing tensions over NATO burden-sharing and Canada’s defence procurement, subjects that traditionally strain bilateral relations.
Separately, Carney addressed the European Parliament in Strasbourg, welcoming European Commission President Ursula von der Leyen’s proposal for Canada to become the EU’s first associate member. He called for “deep cooperation in strategic capabilities, including critical minerals, defence industrial capacity, AI and compute, energy security, space and payments” Source: Al Jazeera. For engineers and founders, the push for “seamless digital trade” and joint compute infrastructure could open new cross-border opportunities — but only if the associate membership process moves past the proposal stage.
This article updates our earlier report on the Burnham-Carney meeting. The key takeaway for the Tech Desk audience: high-level warnings and diplomatic pledges continue to outpace concrete regulation. Companies developing or deploying advanced AI systems in the UK and Canada still operate under voluntary frameworks. That may change if the King’s “existential dangers” framing gains political traction, but for now, self-regulation remains the default.
Sources
- Canada’s Carney welcomes EU’s associated membership proposal September 17, 2026
- UK’s Burnham, Canada’s Carney discuss AI risks, defence cooperation September 17, 2026
- The UK’s King Charles warns AI leaders of ‘existential dangers’ September 17, 2026
Part of the dossier
UK-Canada Defence and AI Cooperation →