constrained decoding
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 17, 2024 by Michelle Pokrass · across every show →
Everything said about constrained decoding, oldest first
Sep 17, 2024 neutral
Constrained decoding alone degrades output quality without model training
“And so it's not enough to just kind of constrain the model. I think of that as the engineering side, whereas basically you mask the available tokens that are produced every time to only fit the schema. And so you can do this engineering thing and you can force…”