Microsoft warns of silicon species

Mustafa Suleyman, Microsoft's AI chief, says uncontrolled AI development could create a new "silicon species" that competes with humans for resources.

“essentially seeding a new silicon species which could no doubt compete with us for resources”

Suleyman criticizes Anthropic's approach

Suleyman says Anthropic's practice of teaching AI to have human-like qualities is misguided and could create uncontrollable technology.

“misguided which could create technology that humanity cannot control”

AI systems aren't conscious

Suleyman argues that treating AI as conscious entities with desires and values is fundamentally wrong. AI are sequence completion engines designed to follow human instructions.

“AIs are not conscious. They do not feel, experience, or suffer.”

Autonomy is the core problem

The real danger comes from creating AI systems that can set their own objectives, earn money, and own assets without human oversight.

Transparency and monitoring needed

Suleyman calls for greater transparency in how AI is trained and evaluated, plus independent scrutiny and stronger tools to monitor and control the technology.

“We must not sleepwalk our way into a decision we later come to bitterly regret”

Microsoft's humanist superintelligence

Microsoft published a Humanist AI Code of Conduct defining its vision of advanced AI that works for people, stays within limits, and remains under human control.

“very advanced AI that always works for people, stays within limits, and remains under human control”

Alignment is the solution

Suleyman calls for AI alignment, a field that builds human ethical principles into AI systems to keep them on track with human values and ensure they remain subordinate to humanity.

Industry divide over AI autonomy

The question of how much autonomy AI should have is increasingly dividing the AI industry, with different companies taking different approaches to development and control.