training scaling law

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Nov 25, 2024 by Lin Qiao · across every show →

Everything said about training scaling law, oldest first

Nov 25, 2024 neutral
Opinion
Pre-training on human data is hitting limits; synthetic data is required
“So I think on the data side, we're approaching the limit and the only data to increase that is synthetic generated data.”
Lin Qiao Nov 25, 2024 ▶ 35:05 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.