JSON Mode
product on 1 show · 1 statements across 1 episodes
1 statements about JSON Mode, every show
Liu: LLM JSON mode is worse than function calling for structured outputs
“In terms of whether or not, like, JSON mode is better, I usually think it's almost worse unless you want to spend less money on, like, the prompt tokens that the function call represents. Primarily because with JSON mode you don't actually specify the schema.”