Meta
Official Meta AI publications
Voicebox speech AI is too open to misuse to release its model or code
01 / THE ORIGINAL CLAIM
“There are many exciting use cases for generative speech models, but because of the potential risks of misuse, we are not making the Voicebox model or code publicly available at this time.”
Meta ·
Deadline given: until Meta shipped voice cloning itself (Oct 2025)
02 / THE REALITY CHECK
FAKEMeta later shipped the technology itself. Since October 2025 its AI 'mimics the sound and tone of a creator's voice' to dub Reels.
Deadline passed 11 months ago
03 / FOLLOW THE EVIDENCE
What actually happened.
-
01
Jun 16, 2023: Meta announced Voicebox but shared only audio samples and a paper, withholding the model and code over misuse risks.
ai.meta.com ↗ -
02
Apr 2024: The open-source OpenVoice instant voice-cloning model from MIT and MyShell moved to the MIT license, 'free for commercial use'. It had already been used 'tens of millions of times'.
github.com ↗ -
03
Mar 2025: Consumer Reports found four of six popular commercial cloning products, including PlayHT, required only a self-attestation that the user had rights to the voice.
innovation.consumerreports.org ↗ -
04
May 2025: The FBI warned that attackers were using AI-generated voice messages to impersonate senior US officials, which confirms the misuse risk was real.
ic3.gov ↗ -
05
Jul 2025: Meta confirmed it had acquired PlayAI, a startup whose platform generates human-like and cloned voices.
techcrunch.com ↗ -
06
Oct 9, 2025: Meta said its AI 'mimics the sound and tone of a creator's voice' to translate Reels into other languages.
about.fb.com ↗
Why it didn't happen
Meta settled this itself by shipping voice cloning. Meta withheld Voicebox over 'potential risks of misuse', then went into voice cloning itself. In July 2025 it bought PlayAI, one of the services Consumer Reports had flagged for weak consent checks, and Meta AI now mimics creators' voices to dub Reels. Open-source instant cloning (OpenVoice) had already been free for commercial use since April 2024. Voice-clone scams did become real, as the FBI warned in 2025, but Meta's own later moves show it didn't treat the technology as too dangerous to ship.
Inspect the original source capture
Evidence
- OpenVoice cloning model: MIT license, free commercial use since Apr 2024 github.com ↗
- Consumer Reports (Mar 2025): 4 of 6 cloning products lacked consent checks innovation.consumerreports.org ↗
- Meta acquires voice-cloning startup PlayAI (Jul 2025) techcrunch.com ↗
- FBI (May 2025): AI voice clones used to impersonate US officials ic3.gov ↗