self-consistency
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 20, 2024 by Sander Schulhoff · across every show →
Everything said about self-consistency, oldest first
Sep 20, 2024 negative
Schulhoff: Self-consistency prompting yields diminishing returns on newer LLMs
“When it came out, it seemed to be quite performant, although more recently, I think as the models have improved, the
Performance of this technique has dropped, and you can see that in the evals we run near the end of the paper, where we use it, and it doesn't …”