Ground Truth

topic on 3 shows · 3 statements across 3 episodes

In Depth Latent Space the a16z Podcast

3 statements about Ground Truth, every show

IN DEPTH Insight
Agrawal: AI evaluations must use comparative analysis because ground truth is flawed
“Turns out ground truth is never ground truth, right? So one of the things we sort of totally changed in our worldview was ground truth is never ground truth. And that we actually have to do comparative analysis of quality and really reframe every customer conv…”
Parag Agrawal Aug 14, 2025 ▶ 26:29 Twitter's former CEO on rebuilding the web for AI | Parag Agrawal (Co-founder and CEO of Parallel)
Shreya Shankar: Practical DocETL users never have pre-annotated ground truth datasets
“So we're redoing our evaluation to be on data sets where we actually have ground truth from human annotators, but that's just not a practical setting. Like, nobody's coming to doc ETL with the ground truth.”
Shreya Shankar Nov 29, 2024 ▶ 49:36 [Paper Club] DocETL: Agentic Query Rewriting + Eval for Complex Document Processing w Shreya Shankar
a16z Assertion Not checkable as stated
Luis von Ahn: Deep learning requires vast human-entered ground truth data
“The other way in which humans are needed here is to create the ground truth. All of these deep learning or deep AI algorithms need A ton of ground truth in order to get very accurate. It has to be entered by humans.”
Luis von Ahn Jan 2, 2019 ▶ 4:54 a16z Podcast | The Taxonomy of Collective Knowledge

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.