StarZero All shows Try the podcast clipper →

evaluation metrics

also referred to as: evaluation metric

2 statements across 2 episodes · 0 bullish · 0 bearish · 2 people on the record · first statement Oct 4, 2023 by Kanjun Qiu · across every show →

Everything said about evaluation metrics, oldest first

Oct 4, 2023
Insight
Kanjun Qiu: AI emergent capabilities are artifacts of evaluation metric design
“If your metric is smooth you actually see slow performance improvement over time, and if your metric is relatively discrete or not smooth, that's where you see the emergence, and it's actually more about the evaluation metric Than about the emergence of the ca…”
Kanjun Qiu Oct 4, 2023 ▶ 21:11 Building Human-Level AI Agents: Imbue CEO Kanjun Qiu on the Road to General Intelligence
Jan 16, 2025
Insight
Chip Huyen: AI evaluation metrics must be derived backward from business use cases
“For applications it's really, really important to understand the use cases well, so they can design like the set of metrics and then you can walk backward from that and map it to like the model metrics.”
Chip Huyen Jan 16, 2025 ▶ 40:52 What You MUST Know About AI Engineering | Chip Huyen, Author of “AI Engineering”
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more