residual connections

1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Dec 31, 2025 by Benjamin Eysenbach · across every show →

Everything said about residual connections, oldest first

Dec 31, 2025 positive
Assertion Supported
Eysenbach: Scaling RL depth requires combining depth with residual connections
“And if we just made the depth bigger, it makes it worse. If we just add residual connections, it didn't make it better. And it was really this combination of factors that Kevin and Ishan figured out that really made this work.”
Benjamin Eysenbach Dec 31, 2025 ▶ 5:56 [NeurIPS Best Paper] 1000 Layer Networks for Self-Supervised RL — Kevin Wang et al, Princeton
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.