Speech and audio AI
4 labs · 40 models and products Theme: Companies · Generated from this page's data. Click a name to open its panel on the Labs page. Records resting on one source are tagged "one source".Speech and audio AI turns text into spoken words, copies a voice from a sample, turns speech into text, and generates music and sound effects. An early example of the modern approach is WaveNet, a 2016 DeepMind paper on generating raw audio waveforms. ElevenLabs, which has teams in London among other cities, builds models that turn text into speech, clone voices and run voice agents, used for audiobooks, dubbing and customer calls (per the site). The tile also lists Google DeepMind's Lyria music models and Stability AI's Stable Audio models.
Context
- DeepMind's WaveNet introduced a neural network that generates raw audio waveforms. 12 September 2016 arxiv.org/abs/1609.03499
This paper introduces WaveNet, a deep neural network for generating raw audio waveforms.
- ElevenLabs raised $500 million in a Series D led by Sequoia, at an $11 billion valuation (reported). 4 February 2026 elevenlabs.io/blog/series-d
This $500 million funding round values ElevenLabs at $11 billion, more than 3x its valuation one year ago.
- ElevenLabs' co-founder Piotr Dabkowski says it builds models across text to speech, transcription and music. 4 February 2026 elevenlabs.io/blog/series-d
building foundational models across the full audio stack - text to speech, transcription, music
- ElevenLabs says it is expanding across London, New York and other cities. 4 February 2026 elevenlabs.io/blog/series-d
continuing its international expansion across London, New York
- Stability AI released Stable Audio Open, an open audio-generation model. 19 July 2024 arxiv.org/abs/2407.14358
Our evaluation shows that the model's performance is competitive with the state-of-the-art across various metrics.
Key papers
- WaveNet: A Generative Model for Raw Audio arXiv preprint · 12 September 2016
- Stable Audio Open arXiv preprint · 19 July 2024
Labs Round 8 (31 Oct 2026): introduction and facts as the researchers wrote them; "(per the site)" marks a sentence resting on this site's own description of that lab.
| Record | What it is | Place | Links | Confidence |
|---|---|---|---|---|
| Cue (forced alignment model)Chips, models and products | A model that lines up each character of a transcript with the exact moment it is spoken in a recording. released (API; inside Scribe)Key facts Published 28 Oct 2026. Runs inside every Scribe transcription and via the Forced Alignment API. Figures (28 Oct 2026): average timing error 179 ms on full recordings (open-source tools 283 ms to 6,000+ ms); 92.7% of sung words within 0.3 s (next best 82.0%); one hour of audio aligned in about half a second on a production GPU.Made by ElevenLabs · 2026-10-28 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/cue-aligner · elevenlabs.io/blog/category/research | lab's own pages |
| Dubbing v2Chips, models and products | An AI dubbing model that translates speech into 90+ languages while keeping the speaker's tone and pacing. released (product)Key facts Released 28 May 2026 in ElevenCreative and ElevenProductions; API "coming soon" at launch; 7-day free trial. Figure: 90+ languages. Earlier work: "The Road to Real-time Dubbing" (2 Nov 2023).Made by ElevenLabs · 2026-05-28 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/introducing-dubbing-v2 · elevenlabs.io/blog/category/research | lab's own pages |
| Eleven English v1 (eleven_monolingual_v1)Chips, models and products | ElevenLabs' first text-to-speech model, trained only on English. deprecatedKey facts Described as the company's "very first model"; trained on an English-only dataset; marked deprecated and due for removal; the 24 Nov 2022 blog describes the beta model (unnamed) as trained on "over 500k hours" of dataMade by ElevenLabs · — (first model; release date not stated)Versions Eleven English v1 → Turbo v2 → Turbo v2.5 | London | help.elevenlabs.io/hc/en-us/articles/17883183930 · elevenlabs.io/blog/thefirstaithatcanlaugh | one source |
| Eleven Flash (v2 and v2.5)Chips, models and products | ElevenLabs' fastest text-to-speech model, built for voice agents that must answer in real time. released (API)Key facts Released 18 Dec 2024. Variants: eleven_flash_v2 (English only) and eleven_flash_v2_5 (32 languages). Figures: 75ms plus application and network latency (18 Dec 2024); models page (read 30 Oct 2026) gives ~100ms median for v2.5 and ~135ms for v2; v2.5 about 50% lower price per character.Made by ElevenLabs · 2024-12-18 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/meet-flash · elevenlabs.io/docs/overview/models | lab's own pages |
| Eleven Multilingual v1Chips, models and products | ElevenLabs' first multilingual text-to-speech model, adding seven languages to its English voice model. supersededKey facts Announced 27 Apr 2023. Languages added (as published): French, German, Hindi, Italian, Polish, Portuguese, Spanish. Built on in-house research. Still listed in the character-limits table of the models page (read 30 Oct 2026); not in the main model list. Succeeded by Multilingual v2 (22 Aug 2023).Made by ElevenLabs · 2023-04-27 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/eleven-multilingual-v1 · elevenlabs.io/blog/category/research | one source |
| Eleven Multilingual v2Chips, models and products | A text-to-speech model that speaks 29 languages, released as ElevenLabs came out of beta. released (API; previous generation)Key facts Released 22 Aug 2023. Figures: 29 languages; up to 10,000 characters (~10 min) per request (models page, read 30 Oct 2026). Status on models page: "previous generation". Access: API (model ID eleven_multilingual_v2).Made by ElevenLabs · 2023-08-22 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/eleven-multilingual-v2 · elevenlabs.io/docs/overview/models | lab's own pages |
| Eleven MusicChips, models and products | A model that writes full songs from plain-language prompts, with or without vocals, cleared for commercial use. released (product and API)Key facts Launched 5 Aug 2025; built with labels, publishers and artists; cleared for most commercial uses (film, TV, podcasts, ads, games). Version history (models page, read 30 Oct 2026): music_v1 → Music v2 (26 May 2026) → Music v2.5 ("Our most advanced music model.").Made by ElevenLabs · 2025-08-05Versions music_v1 → Music v2 (26 May 2026) → Music v2.5 ("Our most advanced music model.") | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/eleven-music-is-here · elevenlabs.io/blog/category/research | lab's own pages |
| Eleven Turbo v2 (eleven_turbo_v2)Chips, models and products | ElevenLabs' first low-latency English speech model, built for real-time use such as phone systems. deprecated (replace with Flash v2)Key facts Announced 9 Nov 2023; about 400 ms latency, over twice as fast as V1 models; output option mulaw 8kHz for VoIP; English only; 0.5 credits per character; now deprecated, replaced by Flash v2 (BIZ-LAB-7024); access: APIMade by ElevenLabs · 2023-11-09 | London | elevenlabs.io/blog/turbo-v2-is-here · elevenlabs.io/docs/overview/models | lab's own pages |
| Eleven Turbo v2.5Chips, models and products | A low-latency text-to-speech model for real-time conversation in 32 languages; now replaced by Flash. deprecatedKey facts Released 19 Jul 2024. Figures (19 Jul 2024): 32 languages; non-English languages 3x faster, English 25% faster. Access: API. Models page (read 30 Oct 2026) lists eleven_turbo_v2_5 and eleven_turbo_v2 as deprecated, replaced by Flash v2.5 and Flash v2.Made by ElevenLabs · 2024-07-19 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/introducing-turbo-v25 · elevenlabs.io/docs/overview/models | lab's own pages |
| Eleven v3Chips, models and products | An expressive text-to-speech model with emotion tags and multi-speaker dialogue in 70+ languages. released (generally available; previous generation)Key facts Alpha research preview 3 Jun 2025; generally available 2 Feb 2026. Figures (2 Feb 2026): "68% reduction in errors"; error rate 15.3% → 4.9% across 27 categories in 8 languages; new version preferred 72% of the time over alpha. Models page (read 30 Oct 2026): 70+ languages, 5,000 characters, "previous generation"; Eleven v3 Conversational ~165ms. Succeeded by Eleven v4 (28 Sep 2026).Made by ElevenLabs · 2025-06-03 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/eleven-v3 · elevenlabs.io/blog/eleven-v3-is-now-generally-av | lab's own pages |
| Eleven v4 and Eleven v4 TurboChips, models and products | ElevenLabs' newest text-to-speech models, producing emotional speech in 90+ languages; the Turbo version is built for live agents. released (API and products)Key facts Released 28 Sep 2026 in ElevenAgents, ElevenCreative and ElevenAPI. Figures (28 Sep 2026): 90+ languages; Turbo median inference ~100ms and time to first speech ~150ms; preferred by ~75% of listeners in blind head-to-head tests; ranked #1 by Artificial Analysis (as claimed); instant voice clones from 10 seconds of audio. Models page: 10,000 characters per request. Predecessor: Eleven v3.Made by ElevenLabs · 2026-09-28 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/eleven-v4 · elevenlabs.io/docs/overview/models | lab's own pages |
| ElevenLabsCompanies | Builds AI models that turn text into speech, clone voices and run voice agents, used for audiobooks, dubbing and customer calls.Profile
Labs Round 7 deep profile (30 Oct 2026), as the researchers wrote it; confidence: single_source (company pages only). Sources Models and products (21)Version chainsmusic_v1 → Music v2 (26 May 2026) → Music v2.5 ("Our most advanced music model.")Eleven English v1 → Turbo v2 → Turbo v2.5
Key facts and news (8)
News
Labs Round 8 (31 Oct 2026), from the researchers' rows; one-source items are marked. | Soho, London (W1F 0DQ) | Companies House · elevenlabs.io/de/blog/series-d · tech.eu/2026/02/04/elevenlabs-raises-500m-says-b · uktech.news/ai/elevenlabs-valued-at-11bn-after-s · elevenlabs.io/blog/tender-22bn | verified |
| Gemini 3.1 Flash Live and Gemini 3.1 Flash TTSChips, models and products | Gemini voice models: Flash Live for real-time spoken conversation and Flash TTS for directed, expressive speech. releasedKey facts Theme: Speech and audio AI. Flash Live released 26 Mar 2026; Flash TTS released 15 Apr 2026 with audio tags; model card "Gemini 3.1 Flash Audio (Flash Live, TTS)" updated 15 Apr 2026. Earlier: Gemini 2.5 native audio (Jun 2025); improved audio models (12 Dec 2025). Later: Gemini 3.8 audio (Sep 2026).Made by Google DeepMind · 2026-03-26 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/blog/rss.xml · deepmind.google/blog/rss.xml | lab's own pages |
| Gemini 3.5 Live Translate and Gemini 3.5 TranscribeChips, models and products | Gemini speech models for near real-time spoken translation and for speech-to-text transcription. releasedKey facts Theme: Speech and audio AI. Live Translate 9 Jun 2026 (AI Studio, Google Translate, Google Meet); Transcribe 26 Aug 2026; model card "Gemini 3.5 Audio (Live Translate, Transcribe, Transcribe Live)" updated 26 Aug 2026.Made by Google DeepMind · 2026-06-09 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/blog/rss.xml · deepmind.google/blog/rss.xml | lab's own pages |
| Gemini 3.8 audio models (Live, Live Extended Thinking, TTS, Live Avatar)Chips, models and products | Gemini's September 2026 real-time voice, text-to-speech and talking-avatar models. releasedKey facts Theme: Speech and audio AI. 3.8 Live and Live Extended Thinking 15 Sep 2026; 3.8 text-to-speech 23 Sep 2026; 3.8 Live with Live Avatar 24 Sep 2026; model card "Gemini 3.8 Audio (Live, Live Extended Thinking, Flash TTS, Flash-Lite TTS)" updated 24 Sep 2026.Made by Google DeepMind · 2026-09-15 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/blog/rss.xml · deepmind.google/blog/rss.xml | lab's own pages |
| Lyria (first version) and Dream TrackChips, models and products | Google DeepMind's first Lyria music-generation model, launched with a YouTube Shorts experiment that made songs in artists' voices. released (limited: YouTube experiment)Key facts Announced 16 Nov 2023; Dream Track experiment with nine artists for a limited set of creators; all Lyria output watermarked with SynthID; access: limited product testMade by Google DeepMind · 2023-11-16Versions Lyria → Lyria 2 | London | deepmind.google/blog/transforming-the-future-of- · deepmind.google/blog/2023-a-year-of-groundbreaki | lab's own pages |
| Lyria 2 (and Music AI Sandbox update)Chips, models and products | Second Lyria music model, offered to musicians and producers in the US through Google's Music AI Sandbox. released (waitlist, US)Key facts Announced 24 Apr 2025 within Music AI Sandbox; access widened to more US musicians, producers and songwriters via waitlist; output watermarked with SynthID; Lyria RealTime named in same post (already listed as BIZ-LAB-7172)Made by Google DeepMind · 2025-04-24Versions Lyria → Lyria 2 | London | deepmind.google/blog/music-ai-sandbox-now-with-n · deepmind.google/models/lyria/ | one source |
| Lyria 3Chips, models and products | Google DeepMind's music generation model that turns a text prompt into a song; it made music creation available in the Gemini app. released (Gemini app, Vertex AI, AI Studio, YouTube, API)Key facts Theme: Speech and audio AI. Released 18 Feb 2026 ("Gemini can now create music"); card updated March 2026; outputs watermarked with SynthID; compared against Lyria 2 (no numeric results). Channels: Gemini app, Google Cloud/Vertex AI, AI Studio, Google Vids, YouTube, Producer AI, Music AI Sandbox.Made by Google DeepMind · 2026-02-18 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/models/model-cards/lyria-3/ · deepmind.google/blog/rss.xml | lab's own pages |
| Lyria 3 ProChips, models and products | A Lyria music model that writes longer tracks with song structure. releasedKey facts Theme: Speech and audio AI. Released 25 Mar 2026; Lyria brought to more Google products.Made by Google DeepMind · 2026-03-25 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/blog/rss.xml | one source |
| Lyria 3.5Chips, models and products | Google DeepMind's newest music model, with better musicality, lyrics and vocals. released (Google Flow Music; Gemini)Key facts Theme: Speech and audio AI. Launched 29 Jul 2026 in Google Flow Music; card same date. Lyria page (read 30 Oct 2026): tracks "up to 3 minutes long"; also lists Lyria RealTime (interactive real-time music) and Magenta RealTime (open Lyria model).Made by Google DeepMind · 2026-07-29 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/models/lyria/ · deepmind.google/models/model-cards/ | lab's own pages |
| Magenta RealTime and Lyria RealTimeChips, models and products | Real-time interactive music generation models; Magenta RealTime is the open Lyria model. released (Magenta RealTime open; dates not on page)Key facts Theme: Speech and audio AI. Listed on the Lyria page (read 30 Oct 2026) with no dates. Earlier: Music AI Sandbox with new features and broader access (April 2025 index).Made by Google DeepMind | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/models/lyria/ · deepmind.google/blog/page/7/ | one source |
| Melia (Speechmatics multilingual speech-to-text model)Chips, models and products | Speechmatics' speech-to-text model that follows speakers who switch between languages within one recording. live (production preview, batch transcription)Key facts 55+ languages in one model (17 Jun 2026); API name melia-1; pricing from $0.129 per hour with 10 hours a month free (17 Jun 2026); wins on FLEURS against Deepgram in 91% of languages, Microsoft 91%, AssemblyAI 77% (vendor figures, 17 Jun 2026)Made by Speechmatics · 2026-06-17 | Cambridge (CB4 0AE) (via Speechmatics) | speechmatics.com/company/articles-and-news/intro · speechmatics.com/ | lab's own pages |
| Multi-speaker dialogue generation (behind NotebookLM Audio Overviews)Chips, models and products | Google DeepMind speech technology that writes out two-person podcast-style conversations as audio, used in NotebookLM Audio Overviews. live (inside Google products)Key facts Post 30 Oct 2024; produces 2 minutes of dialogue in under 3 seconds on a single TPU v5e chip, over 40 times faster than real time; underpins NotebookLM Audio Overviews and Illuminate; model not named; access: inside Google productsMade by Google DeepMind · 2024-10-30 | London | deepmind.google/blog/pushing-the-frontiers-of-au | one source |
| Music v2 (and Music v2.5)Chips, models and products | ElevenLabs' second music model, with better vocals, instruments and song structure and multi-language lyrics. released (product)Key facts Released 26 May 2026 on ElevenMusic and ElevenCreative; API "coming soon" at launch. Pricing for Music v1 and v2 cut by up to 50% (API) and up to 40% (self-serve). Cleared for commercial use. Models page (read 30 Oct 2026) adds Music v2.5 (music_v2_5), undated.Made by ElevenLabs · 2026-05-26 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/introducing-music-v2 · elevenlabs.io/docs/overview/models | lab's own pages |
| Oak-1 (Speechmatics medical speech-to-text model)Chips, models and products | Speechmatics' medical transcription model for clinical consultations where several people speak and the language may change. liveKey facts Average 91% medical-term recall across 11 benchmarked languages vs 74% for eight other providers (vendor figures, 14 Oct 2026); Arabic–English code-switching mixed error rate 15.1% vs 33.2% next best; transcribes an hour of multilingual audio in about 18 seconds in batchMade by Speechmatics · 2026-10-14 | Cambridge (CB4 0AE) (via Speechmatics) | speechmatics.com/company/articles-and-news/meet- · speechmatics.com/ | lab's own pages |
| Owl (PolyAI speech recognition model)Chips, models and products | PolyAI's own speech-to-text model, built to hear callers accurately over phone lines with noise and accents. live (inside PolyAI platform)Key facts Announced 3 Jun 2025; word error rate 0.122, stated as most accurate of the models PolyAI tested; PolyAI says about 70% of its voice agents' errors come from speech recognition; used in PolyAI Agent Studio; access: within PolyAI platform (no standalone release stated)Made by PolyAI · 2025-06-03 | London | poly.ai/blog/owl-speech-recognition-model-polyai · poly.ai/technology | lab's own pages |
| PapercuphistoricalCompanies · also on Start-ups | Made software that dubbed video into other languages with synthetic voices checked by human editors; sold its technology to RWS in 2025 and is in liquidation. wound_downWhy it is here: historical (acquisition and wind-down 2025 already on site; lead reports it in liquidation) — reason: Papercup researchers built their own text-to-speech prosody models and datasetsSelected papers (2) | London | Companies House · rws.com/about/news/2025/rws-acquires-papercups-i · find-and-update.company-information.service.gov. · uktech.news/ai/papercup-funding-16m-20220610 · tvbeurope.com/artificial-intelligence/papercup-i | verified |
| Scribe (v1)Chips, models and products | ElevenLabs' first speech-to-text model, transcribing 99 languages with timings and speaker labels. deprecatedKey facts Released 26 Feb 2025. Figures (26 Feb 2025): 99 languages; FLEURS and Common Voice tests; Italian 98.7% and English 96.7% accuracy as published. Access: Speech to Text API and dashboard. Models page (read 30 Oct 2026) lists scribe_v1 as deprecated, replaced by scribe_v2.Made by ElevenLabs · 2025-02-26 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/meet-scribe · elevenlabs.io/docs/overview/models | lab's own pages |
| Scribe v2 (and Scribe v2 Medical)Chips, models and products | ElevenLabs' second-generation transcription model for bulk transcripts, subtitles and captions; a medical variant handles clinical audio. released (API)Key facts Released 9 Jan 2026. Claims "lowest word error rate recorded on industry-standard benchmarks" (FLEURS named). Up to 100 key terms; up to 56 entity categories. Models page (read 30 Oct 2026): 90+ languages; diarisation up to 32 speakers; Scribe v2 Medical is batch-only and HIPAA-eligible. Predecessor: Scribe v1.Made by ElevenLabs · 2026-01-09 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/introducing-scribe-v2 · elevenlabs.io/docs/overview/models | lab's own pages |
| Scribe v2 RealtimeChips, models and products | A live speech-to-text model for voice agents, meetings and captions. released (API)Key facts Released 11 Nov 2025. Figures (11 Nov 2025): under 150 ms latency; 90 languages; 93.5% accuracy across 30 common European and Asian languages. Access: API and ElevenLabs Agents.Made by ElevenLabs · 2025-11-11 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/introducing-scribe-v2-realtim · elevenlabs.io/docs/overview/models | lab's own pages |
| SFX v3 (sound effects model)Chips, models and products | A model that makes sound effects from text prompts, with better prompt-following and looping. limited access (date not published)Key facts Models page (read 30 Oct 2026): eleven_text_to_sound_v3 in limited access, not in every region; eleven_text_to_sound_v2 remains the Sound Effects API default. No release date published there.Made by ElevenLabs | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/docs/overview/models | one source |
| Speech to Speech voice changer models (English STS v1 and v2; Multilingual STS v2)Chips, models and products | ElevenLabs models that turn one person's recorded speech into another voice while keeping the delivery. released (API)Key facts Model ids eleven_english_sts_v1, eleven_english_sts_v2 (English only) and eleven_multilingual_sts_v2 (29 languages); 10,000-character limit listed for English STS; ElevenLabs blogged on voice conversion research on 6 Sep 2022; access: APIMade by ElevenLabs · — (release dates not stated) | London | elevenlabs.io/docs/overview/models · elevenlabs.io/blog/voice-conversion | one source |
| SpeechmaticsCompanies · also on Software and tools | Makes speech-to-text software that understands many languages, sold to other companies to build into their products.speech recognitionProfile
Round 6 deep profile (30 Oct 2026), as the researchers wrote it; sources are listed in the record panel. Models and products (3)
Key facts and news (4)
Labs Round 8 (31 Oct 2026), from the researchers' rows; one-source items are marked. | Cambridge (CB4 0AE) | Companies House · find-and-update.company-information.service.gov. · uktech.news/ai/speechmatics-series-b-20220628 · uktech.news/featured/speechmatics-raises-6-35m-s · uktech.news/ai/speechmatics-series-b-20220628 | one source |
| Stability AICompanies | Builds open-weight generative models that make images, video and audio from text, including Stable Diffusion and Stable Audio, for media, games and music companies.Profile
Labs Round 7 deep profile (30 Oct 2026), as the researchers wrote it; confidence: single_source. Sources Models and products (27)Version chainsStable Audio 2.0 (3 Apr 2024) → Stable Audio Open (5 Jun 2024) → Stable Audio Open Small (14 May 2025) → Stable Audio 2.5 (10 Sep 2025) → Stable Audio 3.0 (20 May 2026)StableLM → Stable LM 2Stable Diffusion v1 → 2.0 → SDXL → SDXL Turbo → SD3 → SD3.5
Selected papers (12)
Key facts and news (7)
News
Labs Round 8 (31 Oct 2026), from the researchers' rows; one-source items are marked. | Los Angeles | Companies House · stability.ai/news-updates/stability-ai-latest-fu · tech.eu/2026/08/25/stabiityai-raises-76m-with-wa · stability.ai/news/stability-ai-secures-significa · find-and-update.company-information.service.gov. | verified |
| Stable Audio 2.0Chips, models and products | Stability AI's second-generation music and sound generation model. released (product)Key facts Theme: Speech and audio AI. Announced 3 Apr 2024. Version history (lab posts): Stable Audio 2.0 (3 Apr 2024) → Stable Audio Open (5 Jun 2024) → Stable Audio Open Small (14 May 2025) → Stable Audio 2.5 (10 Sep 2025) → Stable Audio 3.0 (20 May 2026).Made by Stability AI · 2024-04-03Versions Stable Audio 2.0 (3 Apr 2024) → Stable Audio Open (5 Jun 2024) → Stable Audio Open Small (14 May 2025) → Stable Audio 2.5 (10 Sep 2025) → Stable Audio 3.0 (20 May 2026) | Los Angeles (via Stability AI) | stability.ai/news-updates/category/Product | one source |
| Stable Audio 2.5Chips, models and products | An enterprise audio model that generates brand music and sound in seconds. released (API and enterprise licence)Key facts Theme: Speech and audio AI. Announced 10 Sep 2025. Figures (10 Sep 2025): tracks up to three minutes; generation in under two seconds on a GPU. Access: StableAudio.com, Stability AI API, partners fal, Replicate, ComfyUI; on-premises under enterprise licence.Made by Stability AI · 2025-09-10 | Los Angeles (via Stability AI) | stability.ai/news-updates/stability-ai-introduce · stability.ai/news-updates | lab's own pages |
| Stable Audio 3.0Chips, models and products | Stability AI's audio model family for music and sound effects, trained on licensed data, mostly with open weights. released (open weights for Small SFX, Small, Medium; Large via API)Key facts Theme: Speech and audio AI. Announced 20 May 2026. Variants: Small SFX, Small, Medium (open weights on Hugging Face, Community Licence; enterprise licence above $1M revenue) and Large (API and enterprise self-hosting). Figures (20 May 2026): up to six minutes (Medium 6:20); Small up to two minutes vs 11 s (Open Small) and 47 s (Open); "fully licensed data".Made by Stability AI · 2026-05-20 | Los Angeles (via Stability AI) | stability.ai/news-updates/meet-stable-audio-3-th · stability.ai/news-updates | lab's own pages |
| Stable Audio OpenChips, models and products | An open-source model for making short audio samples and sound effects. released (open source)Key facts Theme: Speech and audio AI. Announced 5 Jun 2024; research paper post 22 Jul 2024. Stable Audio 3.0 page (20 May 2026) gives its maximum length as 47 seconds.Made by Stability AI · 2024-06-05Read the paper | Los Angeles (via Stability AI) | stability.ai/news-updates/category/Product · stability.ai/news-updates?offset=1742313654132 | one source |
| Stable Audio Open SmallChips, models and products | A small open audio model, released with Arm, that generates sound on phones and other devices. released (open weights)Key facts Theme: Speech and audio AI. Announced 14 May 2025 with Arm (earlier Arm on-device audio post 3 Mar 2025). Stable Audio 3.0 page (20 May 2026) gives its maximum length as 11 seconds.Made by Stability AI · 2025-05-14 | Los Angeles (via Stability AI) | stability.ai/news-updates · stability.ai/news-updates?offset=1742313654132 | one source |
| Text to Sound Effects v2 (eleven_text_to_sound_v2)Chips, models and products | ElevenLabs model that makes sound effects from a written description. released (API; default model)Key facts Remains the default sound-effects model; SFX v3 (BIZ-LAB-7036) has limited access; access: APIMade by ElevenLabs · — (release date not stated) | London | elevenlabs.io/docs/overview/models | one source |
| V2A (video-to-audio research)Chips, models and products | Research system that generates soundtracks, effects and dialogue to match the action in a video. research (not released)Key facts Announced 17 Jun 2024; not opened to the public pending safety assessments and testing; access: none (research)Made by Google DeepMind · 2024-06-17 | London | deepmind.google/blog/generating-audio-for-video/ | one source |
| Voice Design (first generative voice model, in Voice Lab)Chips, models and products | ElevenLabs model that creates new synthetic voices from scratch rather than copying a real speaker. superseded (product)Key facts Announced 11 Jan 2023; "Design Voice" scheduled for February 2023 inside Voice Lab on the beta platform; successor Voice Design v3 already listed (BIZ-LAB-7027); access: productMade by ElevenLabs · 2023-01-11 | London | elevenlabs.io/blog/enter-the-new-year-with-a-ban | one source |
| Voice Design v3Chips, models and products | A tool that creates a new synthetic voice from a written description and offers three options. released (product)Key facts Released 25 Jun 2025 in the ElevenLabs dashboard. Models page (read 30 Oct 2026) lists eleven_ttv_v3 for voice design, 70+ languages.Made by ElevenLabs · 2025-06-25 | Soho, London (W1F 0DQ) (via ElevenLabs) | elevenlabs.io/blog/voice-design-v3 · elevenlabs.io/docs/overview/models | lab's own pages |
| WaveNet (in Google Assistant)Chips, models and products | DeepMind's raw-audio speech generation model (first published 2016), launched in Google Assistant in October 2017. released (in product)Key facts Theme: Speech and audio AI. Original research September 2016 (outside ledger range); launched in Google Assistant October 2017; high-fidelity speech synthesis post November 2017; used to restore voices of speech-impaired users (December 2019).Made by Google DeepMind · 2017-10 | London (EC2M 4AG) (via Google DeepMind) | deepmind.google/blog/page/17/ · deepmind.google/blog/page/14/ | one source |