benchmarks
5 statements across 5 episodes · 1 bullish · 3 bearish · 5 people on the record · first statement Jul 6, 2016 by Michael Kim · across every show →
Everything said about benchmarks, oldest first
Jul 6, 2016 negative
Kim: Top VCs maximize ownership and squeeze LPs out of Series A
“If there is, at the earliest stages, a company that is High quality with high quality investors coming in. LPs are probably the last in line in terms of getting access to that. So imagine a seed funded company by one of our fund managers, a high quality firm l…”
Nov 14, 2022 positive
Aug 28, 2024 negative
Narayanan: AI developers over-optimize models for benchmarks over real-world performance
“When there is so much pressure to do well on these benchmarks, developers are intentionally or unintentionally optimizing these models In ways that look good on the benchmarks, but don't look good in real world evaluation.”
Aug 18, 2025 negative
Jan 15, 2026 neutral