Jeremy Howard

23 statements across 3 episodes · 7 bullish · 10 bearish · 2 people on the record · first statement Oct 20, 2023 by Jeremy Howard · said 8 times in 7 episodes since 2024 · across every show →

On the record as a speaker too: Jeremy Howard's record, appearances and statements → this page counts the times other people say the name.

Mentions by year

brought up most by Shawn Wang (3), Alessio Fanelli (2), Kyle Corbitt (1)

tap a year for its mentions
00335520242025episodesmentions
03520242025episodes it came up in
000.82.51.5520242025episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about Jeremy Howard, oldest first

Oct 20, 2023 negative
Opinion
Howard: AI research went backwards for years pursuing zero-shot learning
“And so I actually feel like we kind of went backwards for years and not to be honest, I mean, I'm a bit sad about this now, but I kind of got so disappointed and dissuaded by like, It felt like these bigger lab, much bigger labs, you know, like fast.ai had onl…”
Jeremy Howard Oct 20, 2023 ▶ 19:29 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023 negative
Insight
Howard: Focusing on massive compute infrastructure is a distraction in AI
“It might seem like a recent thing, but actually throughout my 30 years in data science, the attention's always been on, you know, the big iron results. So when I first started, everybody was talking about data warehouses, and it was all about Teradata, and it'…”
Jeremy Howard Oct 20, 2023 ▶ 21:22 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023 neutral
Disclosure
Howard: Fast.ai was never more than two people and is now solo
“That's just one of, like, three things we do, is the course, you know, and it's only ever been at most two people, either me and Rachel, or me and Sylvain. Nowadays it's just me.”
Jeremy Howard Oct 20, 2023 ▶ 28:31 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023
Assertion Supported
Howard: Experiments show LLMs can memorize full datasets in one epoch
“And so we ran a bunch of experiments, and all of them supported the hypothesis that it was memorizing the data set in a single thing at once.”
Jeremy Howard Oct 20, 2023 ▶ 41:14 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023 negative
Assertion Not checkable as stated
Howard: NLP researchers unanimously insisted transfer learning would never work for language
“Like, the reason it took me so long to try it was because I asked all my friends in NLP if this could work, and everybody said, no, it definitely won't work. It wasn't like, oh, maybe. Everybody was like, it definitely won't work. NLP is much more complicated …”
Jeremy Howard Oct 20, 2023 ▶ 14:41 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023
Assertion Supported
Howard: Enlitic was the first company to use deep learning in medicine
“Yeah, I was actually the first company to use deep learning in medicine, so I kind of founded the field.”
Jeremy Howard Oct 20, 2023 ▶ 3:28 The End of Finetuning — with Jeremy Howard of Fast.ai
Oct 20, 2023 negative
Opinion
Jeremy Howard: The three-step ULMFiT fine-tuning approach is wrong and obsolete
“Even though I originally created the three-step approach that everybody now does, my view is it's actually wrong, and we shouldn't use it.”
Jeremy Howard Oct 20, 2023 ▶ 44:27 The End of Finetuning — with Jeremy Howard of Fast.ai
Aug 17, 2024 neutral
Disclosure
Howard: Answer.ai required angel investors to commit to long-term voting principles
“When we did our second round, which was an angel round, we had everybody invest through a long-term SBV, which we set up. Where everybody had to agree to vote in line with long-term value principles.”
Jeremy Howard Aug 17, 2024 ▶ 11:05 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 negative
Insight
Howard: Non-profit boards cannot control commercial entities with equity-compensated staff
“This didn't make sense to have like a so-called non-profit where then there are people working at a commercial company that's owned by or controlled nominally by the non-profit where the people in the company are being given the equivalent of stock options. Li…”
Jeremy Howard Aug 17, 2024 ▶ 7:55 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 positive
Insight
Howard: Training stages form a continuum allowing deep modification of pre-trained models
“Sorry, it wasn't the end of fine-tuning, but more that we should treat it as a continuum, and we should have much higher expectations of how much you can do with an already trained model. You can really add a lot of behavior to it. You can change its behavior.…”
Jeremy Howard Aug 17, 2024 ▶ 2:04 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 positive
Insight
Howard: Developers should distribute merged adapters rather than merged models
“To explain, it's not that you shouldn't merge models, it's that you shouldn't be distributing a merged model. You should distribute it a merged adapter. 99% of the time. And actually often, one of the best things happening in the model merging world is actuall…”
Jeremy Howard Aug 17, 2024 ▶ 46:26 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 positive
Disclosure
Howard: Answer.ai operates with no managers and zero corporate hierarchy
“We don't have any managers. We don't have any hierarchy from that point of view. So, for example, I'm not a manager, which means I don't get to tell people what to do or how to do it or when to do it.”
Jeremy Howard Aug 17, 2024 ▶ 19:28 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 neutral
Insight
Howard: Pre-training data mixes should be continuous per-batch functions, not discrete phases
“So the point at which they're doing proper continued pre-training is the point at which that becomes a continuum rather than a phase. So the only difference with what I was describing last time is to say, like, oh, they should, you know, There's a function or …”
Jeremy Howard Aug 17, 2024 ▶ 4:08 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 positive
Insight
Howard: Public Benefit Corporation status allows founders to reject hostile buyouts
“If you're not a public benefit corporation, Then somebody can come along and offer to buy you with a stated description of, like, turning your company into the thing you most hate, right? And if they offer you more than the market value of your company and you…”
Jeremy Howard Aug 17, 2024 ▶ 12:20 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 negative
Opinion
Howard: Cursor and VS Code shoehorn AI into legacy software paradigms
“It's like a convenience over the top of this incredibly complicated system that full-time, sophisticated software engineers have designed over the past few decades in a totally different environment as a way to build software, you know. And so we're trying to,…”
Jeremy Howard Aug 17, 2024 ▶ 59:58 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 positive
Assertion Not checkable as stated
Howard: 80% of top unique creators have unconventional or non-mainstream backgrounds
“Like, 80% of the time, I find out the person has a really unusual background. So, like, often they'll have, like, either they, like, came from poverty and, like, didn't get an opportunity to go to good school, or they, like, you know, had dyslexia and, you kno…”
Jeremy Howard Aug 17, 2024 ▶ 15:43 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 negative
Insight
Howard: Corporations are sociopathic by design due to fiduciary duty
“Companies are sociopathic, like, by design. And so the alignment problem, as it relates to companies, has not been solved. Like, companies become huge, they devour their founders, they devour their communities, and they do things where even the CEOs, you know,…”
Jeremy Howard Aug 17, 2024 ▶ 9:09 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 neutral
Opinion
Howard: Meta's schedule-free optimizers are not that exciting
“I mean, I don't care very much, honestly. Like, I don't think that schedule-free optimizer's that exciting. It's fine.”
Jeremy Howard Aug 17, 2024 ▶ 5:01 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 bullish
Disclosure
Howard previews AI Magic, his upcoming dialogue engineering system
“So, I've created a new approach. It's not called prompt engineering. It's called dialogue engineering. And I'm creating a system for doing dialogue engineering. It's currently called AI Magic. I'm doing most of my work in this system, and it's making me much m…”
Jeremy Howard Aug 17, 2024 ▶ 57:10 Answer.ai & AI Magic with Jeremy Howard
Aug 17, 2024 negative
Insight
Howard: Training AI models from random weights is almost never justified
“If you're training for random weights, you better have a really good reason, you know, because it seems so unlikely to me that nobody has ever trained on data that has any similarity whatsoever to the general class of data you're working with, and that's the o…”
Jeremy Howard Aug 17, 2024 ▶ 2:54 Answer.ai & AI Magic with Jeremy Howard
Oct 2, 2025 negative
Insight
Howard: Correcting LLM errors in chat history degrades subsequent model answers
“The autoregressive nature of language models means that if they make a mistake, and you correct it, and then say, no, that was a mistake, please do it this way instead. The more often you do that, the worse the dialogue answers get. Because it's in the trainin…”
Jeremy Howard Oct 2, 2025 ▶ 16:17 The antidote to AI fatigue — Answer.ai Solveit
Oct 2, 2025 positive
Disclosure
Ries: Answer.AI will never need more than 12 employees in total
“I can remember where I was when Jeremy told me, by the way, he doesn't think the company will ever need more than 12 employees. And I was like, oh sure, you mean like this month, you know, but it's like, no, over its entire life.”
Eric Ries Oct 2, 2025 ▶ 3:43 The antidote to AI fatigue — Answer.ai Solveit
Oct 2, 2025 negative
Insight
Jeremy Howard: AI coding should prioritize human learning over vibe coding
“We want to make sure at the end of building something, two things have happened. The first is you understand every line of code fully, why it's there, what it does, and that you've learned from the process. So at the end of this process, you're a better develo…”
Jeremy Howard Oct 2, 2025 ▶ 26:43 The antidote to AI fatigue — Answer.ai Solveit
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.