The Prompt Report

2 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 20, 2024 by Sander Schulhoff · said 7 times in 1 episodes since 2024 · across every show →

Mentions by year

brought up most by Shawn Wang (7)

tap a year for its mentions
0041812024episodesmentions
0112024episodes it came up in
0040.5812024episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about The Prompt Report, oldest first

Sep 20, 2024 negative
Assertion Supported
Schulhoff: Self-consistency prompting yields diminishing returns on newer LLMs
“When it came out, it seemed to be quite performant, although more recently, I think as the models have improved, the Performance of this technique has dropped, and you can see that in the evals we run near the end of the paper, where we use it, and it doesn't …”
Sander Schulhoff Sep 20, 2024 ▶ 39:11 The Ultimate Guide to Prompting - with Sander Schulhoff from LearnPrompting.org
Sep 20, 2024
Assertion Supported
Schulhoff: Few-Shot Exemplar Order Can Shift Model Accuracy From 0% to 90%
“How you order your exemplars in the prompt is super important. And we've seen this move accuracy from like zero percent to 90%, like Zero to state of the art on some tasks, which is just ridiculous”
Sander Schulhoff Sep 20, 2024 ▶ 22:22 The Ultimate Guide to Prompting - with Sander Schulhoff from LearnPrompting.org
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.