Decoder Models

topic on 1 show · 2 statements across 1 episodes

Latent Space

2 statements about Decoder Models, every show

LATENT SPACE Assertion Not checkable as stated
Howard: Decoder models must be far larger to match DeBERTa
“Now, the interesting thing is, you see, unlike Kaggle competitions, that decoder models still Are at least competitive with things like DiBerta VIII. But they have to be way bigger to be competitive with things like DiBerta VIII. And the only reason they are c…”
Jeremy Howard Aug 17, 2024 ▶ 35:33 Answer.ai & AI Magic with Jeremy Howard
Howard: Decoder models make little sense for non-generative tasks
“So anytime you're not generating an arbitrary length sequence of tokens decoder models don't seem to make much sense to me.”
Jeremy Howard Aug 17, 2024 ▶ 35:23 Answer.ai & AI Magic with Jeremy Howard

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.