From Engadget · Jackson Chen · · 1m 20s
Anthropic hires Accenture to watch its AI safety
The AI company embeds third-party evaluators to monitor model training and deployment as part of a plan to slow development.
In brief
The AI company embeds third-party evaluators to monitor model training and deployment as part of a plan to slow development. Anthropic is bringing in outside auditors to oversee its AI safety practices in real time, investing $1 billion over five years to prove the model works. Originally reported by Engadget.
Anthropic taps Accenture for AI oversight
Anthropic announced a partnership with Accenture to embed third-party safety evaluators within the company. Both firms will invest at least one billion dollars each over five years.
Part of CEO's plan to slow AI
CEO Dario Amodei proposed a three-step approach last week to slow AI development. Embedding third-party evaluators is the first step.
Evaluators get deep access to models
Accenture's embedded evaluators will watch models during training, review deployment decisions, and speak directly with employees. They'll report incidents and assess model alignment.
“watch models take shape in training, follow the decisions that govern how those models are built and deployed and speak directly to employees”
Why Accenture was chosen
Anthropic selected Accenture for its experience helping businesses and governments deploy AI across industries. Accenture understands how enterprises use AI systems.
Standards still being worked out
Anthropic acknowledged that embedded evaluators are a new concept with no established standards yet. The company will work with other evaluators beyond Accenture in coming weeks.
More evaluators coming soon
Anthropic plans to announce additional third-party evaluators in the coming weeks. Accenture will also evaluate AI models for other companies beyond Anthropic.
The bottom line
Anthropic is bringing in outside auditors to oversee its AI safety practices in real time, investing $1 billion over five years to prove the model works.
