Pope’s AI Advisor Warns of Lab Cartel Risks

Pope’s AI advisor fears big labs form a cartel by ignoring public debate on AI safety.

By ·

Sep 23, 2026

7 cards · 1m 10s · tap to begin

From · · · 1m 10s

Pope’s AI Advisor Warns of Lab Cartel Risks

Pope’s AI advisor fears big labs form a cartel by ignoring public debate on AI safety.

In brief

Pope’s AI advisor fears big labs form a cartel by ignoring public debate on AI safety. Father Paolo Benanti warns AI labs risk becoming a cartel by excluding public input on safety standards. Originally reported by WIRED.

AI Safety Warnings

Researchers warn AI development could extinguish humanity due to rapid progress and US-China rivalry.

Father Paolo Benanti’s View

Father Paolo Benanti theologian and advisor to Pope Francis and President of the Commission on Artificial Intelligence...

Benanti says ethics must be debated publicly, not controlled by company boards, for democratic regulation.

“Ethics cannot be something that belongs to the board of trustees of a company. It’s something that has to be balanced, mitigated in debate in the public square.”

AI Safety Proposals

Anthropic’s CEO Dario Amodei calls for mandatory third-party AI model evaluations and crackdown on distillation.

Cartel Concerns

Benanti warns big labs form a cartel by self-interestedly dictating AI rules without public input.

“This has a really clear name: a cartel.”

Superintelligence Debate

Superintelligence Debate

Benanti criticizes AI industry’s reverence for superintelligence as divine, saying it risks delusion about machine capabilities.

“We are not building the next divinity. We are simply deluding ourselves that there is something more than statistical computation.”

Pope’s Encyclical

Pope Leo XIV published an encyclical on AI, warning against technocratic logic and urging international collaboration.

“The danger of humanity becoming a victim of its own achievements.”

Human Control Needed

Benanti stresses the need for human brakes and control over AI to prevent lab dominance.

“We need brakes, and a wheel. That means a significant position of control for human beings over the machine.”

The main idea

Father Paolo Benanti warns AI labs risk becoming a cartel by excluding public input on safety standards.

Read the original on WIRED

React

Sign in to react and comment.

Comments (0)

Life is short. Keep it sweet. Respect others' opinions and be kind!

    Recommended next

    More decks on pope and related topics.