neural networks

also referred to as: neural network

9 statements across 7 episodes · 6 bullish · 1 bearish · 7 people on the record · first statement May 17, 2017 by Wojciech Zaremba · across every show →

Everything said about neural networks, oldest first

May 17, 2017 positive
Insight
Zaremba: Neural networks unified text, image, and sound under one methodology
“The cool thing about neural networks is, it used to be the case that people specialized in processing text, images, sound, and these days, this is the same group of people. They, we are using the same method.”
Wojciech Zaremba May 17, 2017 ▶ 26:42 An AI Primer with Wojciech Zaremba · Y Combinator
Aug 11, 2017 positive
Insight
Neural networks learn English spelling and exceptions purely from data
“But now it's all data-driven, so if I hear enough of these unusual words, You see these neural networks actually learn to spell on their own, even considering all the weird exceptions of English.”
Adam Coates Aug 11, 2017 ▶ 11:29 Baidu's AI Lab Director on Advancing Speech Recognition and Simulation · Y Combinator
May 9, 2018 neutral
Insight
Schönlieb: Exactly minimizing training loss often hurts neural network generalization
“You do not necessarily need to solve your optimization problem, your training exactly. And maybe sometimes, or most of the time you actually don't want it, want to save it exactly because you only have a finite amount of training examples. And so when you thin…”
Carola Schönlieb May 9, 2018 ▶ 23:20 Mathematical Approaches to Image Processing with Carola Schönlieb · Y Combinator
May 9, 2018 negative
Assertion Supported
Medical AI models trained on one scanner brand fail on others
“Also the type of scanner you're using, are you using a G or a Siemens or Toshiba or whatever they have different settings, And they have different ways of going from the measurements to an image. And so, you know, if you train an algorithm, for instance, a neu…”
Carola Schönlieb May 9, 2018 ▶ 14:57 Mathematical Approaches to Image Processing with Carola Schönlieb · Y Combinator
Nov 8, 2024 neutral
Assertion Not checkable as stated
Altman: Stanford AI lab told students not to work on neural nets
“I went to school to study AI. But at the time I was working in the AI lab, the one thing that they told you is definitely don't work on neural networks. We tried that. It doesn't work.”
Sam Altman Nov 8, 2024 ▶ 35:55 How To Build The Future: Sam Altman · Y Combinator
Jan 31, 2025 positive
Insight
McGrew: Solving Dota 2 proved scale enables AI generalization
“And there was real insight that was generated there, which was that it really strengthened our belief that scale was the path to improving artificial intelligence. That with Dota two, the secret idea was that we could take huge amounts of experience and feed i…”
Bob McGrew Jan 31, 2025 ▶ 3:29 Bob McGrew: AI Agents And The Path To AGI · Y Combinator
Jun 19, 2025 positive
Assertion Supported
Tesla Autopilot neural networks systematically replaced explicit C++ code
“As we made the autopilot better, basically the neural network grew in capability and size, and in addition to that, all the C++ code was being deleted and kind of like was And a lot of the kind of capabilities and functionality that was originally written in o…”
Andrej Karpathy Jun 19, 2025 ▶ 4:57 Andrej Karpathy: Software Is Changing (Again) · Y Combinator
Jun 19, 2025 bullish
Insight
LLMs establish Software 3.0 where natural language prompts are programs
“And I think what's changed, and I think is a quite fundamental change, is that neural networks became programmable. With large language models. And so I see this as quite new, unique. It's a new kind of a computer. And so in my mind, it's worth giving it a new…”
Andrej Karpathy Jun 19, 2025 ▶ 3:03 Andrej Karpathy: Software Is Changing (Again) · Y Combinator
Jul 26, 2026 positive
Assertion Not checkable as stated
Huang: NVIDIA had neural video simulators years before public video models
“Long before the first videos were generated outside that people saw a couple of years earlier inside our labs, we were driving a simulator completely generated by video, and computer, completely generated by neural networks”
Jensen Huang Jul 26, 2026 ▶ 34:42 Jensen Huang: The Mindset That Built NVIDIA · Y Combinator
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.