training data

3 statements across 3 episodes · 1 bullish · 1 bearish · 3 people on the record · first statement Apr 25, 2023 by Noam Shazeer · across every show →

Everything said about training data, oldest first

Apr 25, 2023 neutral

Insight

AI Data Needs Scale With the Square Root of Compute

“The data requirements tend to go up like with the square root of the amount of computation, because you're going to train a bigger model and then you're going to throw more data at it.”

Noam Shazeer Apr 25, 2023 ▶ 10:54 No Priors Ep. 12 | With Noam Shazeer

Aug 3, 2023 positive

Assertion Not checkable as stated

Biewald: Yahoo Search Success Depended Entirely On Local Training Data Quality

“The model that I'm building is like the same for each country. It's the training data though is different. So some countries would take the training data collection process really seriously and they'd get a great model. And some would just like really half-ass…”

Lukas Biewald Aug 3, 2023 ▶ 6:09 No Priors Ep. 26 | With Weights & Biases CEO Lukas Biewald

Sep 28, 2023 negative

Insight

Kelly: Biological AI's main bottleneck is availability of training data

“The big limitation in bio is the availability of data to train these things, right? And so you have this tough situation where, like, everyone is doing these models of training on the same data, right?”

Jason Kelly Sep 28, 2023 ▶ 18:55 No Priors Ep. 34 | With Ginkgo Bioworks Co-Founder and CEO Jason Kelly

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

training data

Everything said about training data, oldest first

Turn any episode into a week of clips.