AssemblyAI is training its next speech model on ~4 million hours of audio
Dylan Fox · Generative AI for Speech Recognition | AssemblyAI Founder & CEO, Dylan Fox · May 1, 2023 · at 14:19
Dylan Fox, Founder and CEO of AssemblyAI, reveals the training scale for AssemblyAI's next-generation speech recognition model.
0:00 / 0:12exact quote · 12.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We're actually training conformer two or what might call it 1.5, but whatever this accessory will be is training right now. And that's something around four million hours of labeled audio data.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dylan Fox
Major cloud providers are too big to ship good developer products
“I'm surprised the big cloud companies, and apologies if anyone here works there, I'm surprised they can't ship, you know, better developer products, but it's, I think they're maybe just too big at this point.”
Most speech AI value comes from downstream workflows, not just transcription
“Where a lot of value is created is you're taking the transcription, and then you're using it as an input to do something else.”
Fox: AssemblyAI delays exploratory model investment until developers prove value
“Some of these other things that are more exploratory, like, we're not gonna put a ton of effort into those until we see that our customers the developers that use our API are actually able to find value and create value with those.”
Most commercial speech models historically trained on roughly 50,000 hours of audio
“And our models prior, and most commercial speech recognition models trained on like, 50,000 hours”