From Newsweek · · 1m 10s
Dessa AI voice model removes robotic safety feature
Dessa AI voice model removes robotic safety feature, raising scam risks.
In brief
Dessa AI voice model removes robotic safety feature, raising scam risks. Dessa AI voice model, trained on human conversation, mimics speech so convincingly it removes traditional robotic voice safety features but increases scam risks. Originally reported by Newsweek.
Dessa AI voice model
Dessa is a new artificial intelligence model from Jack Dorsey's Block that mimics human speech convincingly.
Robotic voice safety feature
Robotic voices were a safety feature to indicate nobody was present, but Dessa removes this tell.
Dessa's training method
Dessa was trained only on recorded human conversation to capture every sigh, giggle, and stumble.
Creative industry benefits
Dessa reduces costs for creative industries to generate more realistic AI productions.
Scam risks increase
Scammers can now use Dessa to make calls that sound like trusted contacts, increasing fraud targets.
“Scammers already use AI to smooth the rough edges of their emails, the FBI warns”
Marco Rubio impersonation
An impostor used Dessa to mimic Marco Rubio's voice for foreign ministers and a member of Congress.
Joe Biden robocall
Two days before the 2024 New Hampshire primary, an AI imitation of Joe Biden cost $150 to make.
Dessa's safety concerns
Dessa's team acknowledges risks and wants outside researchers to help address them.
“A model that learned to talk from sound alone is new territory, and we want outside eyes on it”
The key point
Dessa AI voice model, trained on human conversation, mimics speech so convincingly it removes traditional robotic voice safety features but increases scam risks.
