StarZero All shows Try the podcast clipper →

AI evals

2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Mar 13, 2025 by Hamel Husain · across every show →

Everything said about AI evals, oldest first

Mar 13, 2025 positive
Insight
Husain: Basic spreadsheet skills are enough to run AI evals
“The foundation of evals is error analysis. So like looking at your data and doing data analysis on your traces. So a lot of people, when we say data literacy, that can mean, that can sound scary, but it can come from a lot of different places. It can be, you c…”
Hamel Husain Mar 13, 2025 ▶ 21:37 [Lightning Pod] Evals: How to Improve AI Consistently — with Hamel Husain and Shreya Shankar
May 21, 2025 positive
Insight
Alberti: Small numbers of manually curated evals beat large eval sets
“I think usually like small numbers of very high quality evals are the way to go and like we curate them manually and make sure they're really good.”
Silas Alberti May 21, 2025 ▶ 17:39 DeepWiki: The GitHub Encyclopedia
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more