Constrained Decoding
topic on 1 show · 1 statements across 1 episodes
1 statements about Constrained Decoding, every show
Constrained decoding alone degrades output quality without model training
“And so it's not enough to just kind of constrain the model. I think of that as the engineering side, whereas basically you mask the available tokens that are produced every time to only fit the schema. And so you can do this engineering thing and you can force…”