Oxford researcher Toby Ord discusses fears about AI risks

In short: A Financial Times podcast features Oxford researcher Toby Ord discussing growing public anxiety that powerful AI could create extreme risks, including threats to human survival.

What's going on

Concerns about artificial intelligence are rising again, helped along by recent safety incidents and public warnings from some people inside the tech industry.

In a new episode of the Financial Times podcast Rachman Review, host Gideon Rachman interviews Toby Ord. Ord is a senior researcher at Oxford University’s AI Governance Institute, which studies how rules and oversight could shape the way AI is built and used. Ord is also the author of The Precipice: Existential Risk and the Future of Humanity.

The episode focuses on “existential risk.” That is a risk so severe it could end human civilization, like a global catastrophe that we cannot recover from (think of it as a house fire that destroys the whole building, not just one room). Ord discusses why some people believe increasingly capable AI systems could, in the worst case, contribute to that kind of danger.

A key question in the conversation is whether governments can regulate AI effectively. Regulation here means laws and rules that limit what companies can build, how they test systems, and how they release them. The podcast also raises the idea that AI progress may be moving so fast that it is hard to “put the genie back in the bottle,” meaning it could be difficult to roll back once powerful systems are widely available.

What to watch

More public discussion is likely as AI tools become more capable and more common. Watch for concrete proposals from governments and companies about safety testing, limits on certain uses, and who is responsible when AI systems cause harm.

Source: Financial Times