This talk is part of the series Behind the paper with Royal Society journals, a webinar series that spotlights recent papers from the Royal Society’s journals. This seminar accompanies the Philosophical Transactions of the Royal Society A theme issue Safe, secure and robust AI for safety-critical systems, in which my paper Is it Safe to Deploy AI in Safety-Critical Systems? appears. I will be one of several speakers.
Date and Time: Monday, September 28, 2026, 9:00 AM PDT / 12:00 PM EDT / 16:00 UTC / 17:00 BST.
Talk title: Is it safe to deploy AI in safety-critical systems?
Abstract: We consider the reality of deploying artificial intelligence (AI) in safety-critical systems, such as autonomous vehicles, medical diagnoses and weather forecasting. Our discussion is grounded in the mathematical nature of AI systems, including how an AI’s mathematical properties relate to its benefit and risk profile. Benefits include the ability to learn models from data even when no physical model exists, increased automation and enhanced speed compared with traditional approaches. Risks of AI include its opaque (mis-)understanding of the world, failures on out-of-distribution inputs, its insatiable appetite for data and computation and the ongoing challenge of aligning the AI’s objectives with human values. Such risks are potentially manageable with clear-eyed expectations, and our hope in this work is to clarify what can be expected.