Arabic
topic on 2 shows · 3 statements across 3 episodes
3 statements about Arabic, every show
Misra: Whisper and standard transcription models perform poorly in Arabic
“Whisper doesn't work in Arabic that well. Right. So we had to figure out how to make something work in Arabic, but it can't be bad because Almost all transcription is bad in Arabic, right? There's just not enough training that's been done on that language.”
Feldman: Poor tokenization schemes heavily bias foundation models toward English
“One of the things we learned was that it's really important taking into account
The language that has fewer tokens, especially, you know, Arabic, Hebrew, Hindi, their characters sometimes require two bits rather than one bit, and so the tokenization scheme has…”