Assertion Supported
Reddy: Voxtral speech model is much stronger than Whisper
“And I think a big people, I think there's a big rich ecosystem of people finding whisper and people want the same thing with Voxer. It's much stronger than whisper.”
Insight
Reddy: Continuous flow matching outperforms discrete audio tokens for speech generation
“So the thing we did differently is instead of having this autoregressive K step prediction, we have a flow matching model. Instead of modeling this as a discrete token set, we trained the codec to be both discrete and continuous to have this flexibility. So we…”
Opinion
Reddy: Mistral introduces the first strong open multilingual causal audio encoder
“And there we have a causal encoder. And I don't think there's any strong multilingual causal encoder out in the community. So we thought it's a good contribution.”
Insight
Reddy: Audio AI has no winning architecture yet
“One more meta point is unlike text, even in vision, I think this is true, but in audio, it's definitely true. There is no winner model yet. There is no, okay, this is the way you do things. It's still evolving. I think people are still iterating and figuring o…”
Assertion Partly supported
Reddy: Voxtral TTS is a 3B model based on the Ministral architecture
“It's it came out with such good quality, and Guillaume was mentioning, yeah, it's a three B model it's based off of the ministral model that we actually released just a few months back, and insert trunk, and it mainly meant for like the TTS stuff, but they nee…”
Disclosure
Reddy: Mistral chose autoregressive TTS to enable real-time streaming voice agents
“One of the main applications is voice agents and we want real time streaming and that's the use case. That's not the only use case, but that's one of the primary use cases we want to get to. So we pick the autoregressive approach for that.”
Assertion Supported
Reddy: Mistral reduces flow-matching audio inference to 16 steps
“When you have a depth transformer, if you have K tokens, you need to do K autoregressive steps, right? Even though it's a small thing, it's like K steps, which is very latency heavy with flow matching. We were able to cut it down significantly, so we are able …”
Assertion Supported
Reddy: Voxtral TTS processes audio at 12.5 Hz, enabling 30-minute contexts
“So the model processes audio at 12.5 Hertz. So one second maps to like, Full point by tokens. So I think one minute is like seven pointy tokens. So you can get like up to 10 minutes in like eight K context window and get half an hour and 30 K context window.”
