StarZero All shows Try the podcast clipper →

decoder models

2 statements across 1 episodes · 0 bullish · 2 bearish · 1 people on the record · first statement Aug 17, 2024 by Jeremy Howard · across every show →

Everything said about decoder models, oldest first

Aug 17, 2024 bearish
Opinion
Howard: Decoder models make little sense for non-generative tasks
“So anytime you're not generating an arbitrary length sequence of tokens decoder models don't seem to make much sense to me.”
Jeremy Howard Aug 17, 2024 ▶ 35:23 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 bearish
Assertion Not checkable as stated
Howard: Decoder models must be far larger to match DeBERTa
“Now, the interesting thing is, you see, unlike Kaggle competitions, that decoder models still Are at least competitive with things like DiBerta VIII. But they have to be way bigger to be competitive with things like DiBerta VIII. And the only reason they are c…”
Jeremy Howard Aug 17, 2024 ▶ 35:33 Answer.ai & AI Magic with Jeremy Howard
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more