StarZero All shows Try the podcast clipper →

Jack Morris

13 statements across 1 episodes · 5 bullish · 2 bearish · 1 people on the record · first statement Jul 2, 2025 by Jack Morris · said 8 times in 2 episodes since 2025 · across every show →

On the record as a speaker too: Jack Morris's record, appearances and statements → this page counts the times other people say the name.

Mentions by year

brought up most by Allen Park (6), Shawn Wang (1), Dan Biderman (1)

tap a year for its mentions
00418120252026episodesmentions
01120252026episodes it came up in
0040.58120252026episodesmentions per episode
2026 7 mentions in 1 episode
2025 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about Jack Morris, oldest first

Jul 2, 2025 bullish
Prediction Not checkable as stated
Morris: The next AI paradigm shift will stem from an unused data source
“And so whatever the fifth thing is, whether it's Video or embodied AI or some kind of crazy innovation on reasoning models. Whatever comes next will probably be some type of new data source that we're not using yet.”
Jack Morris Jul 2, 2025 ▶ 1:12:04 Information Theory for Language Models: Jack Morris
Jul 2, 2025 negative
Assertion Not checkable as stated
Jack Morris: Most AI research was previously open, but is now closed
“Most stuff was open. Now most stuff is not open.”
Jack Morris Jul 2, 2025 ▶ 3:39 Information Theory for Language Models: Jack Morris
Jul 2, 2025 positive
Insight
Morris: Weight deltas can reconstruct a competitor's proprietary fine-tuning dataset
“There's some tricks to it, but it's basically just like gradient based selection based on this weight difference. And it seems to be okay. Like it can get us pretty good training data. So I guess if you actually wanted to use this, it would be like your compet…”
Jack Morris Jul 2, 2025 ▶ 1:04:42 Information Theory for Language Models: Jack Morris
Jul 2, 2025 neutral
Assertion Supported
Morris: 32-bit transformer models store only 3.6 to 3.9 bits per parameter
“Transformers that are trained in 32 bit precision, we approximate can store about 3.6 bits of information to maybe 3.9 bits somewhere in there per parameter.”
Jack Morris Jul 2, 2025 ▶ 56:00 Information Theory for Language Models: Jack Morris
Jul 2, 2025 neutral
Assertion Supported
Morris: Embedding inversion requires access to and repeated queries of the encoder
“Like none of the vector to text stuff works unless you have this assumption of like knowing the encoder and also being able to make a lot of queries to it.”
Jack Morris Jul 2, 2025 ▶ 32:44 Information Theory for Language Models: Jack Morris
Jul 2, 2025 bearish
Opinion
Morris: No Evidence We Can Build Pure Reasoning Models Without World Knowledge
“I don't think we have a lot of evidence that we can build a system like this that like is really, really good at reasoning, but really dumb about the world. Like, I don't know if we have the tools.”
Jack Morris Jul 2, 2025 ▶ 41:31 Information Theory for Language Models: Jack Morris
Jul 2, 2025
Insight
Morris: Re-implementing new paradigm shifts quickly is the best AI grad strategy
“Honestly, if I were to give advice to a younger grad student, I think the way to do it would be literally just like sit and wait until the next kind of paradigm shift and then just immediately start working as fast as you can to like re-implement it. Like, I d…”
Jack Morris Jul 2, 2025 ▶ 5:28 Information Theory for Language Models: Jack Morris
Jul 2, 2025 neutral
Assertion Not checkable as stated
Jack Morris: Fundamental AI science shifted to companies due to academic compute limits
“That's when I think things really started to change in terms of the types of questions you wanted to ask can't always be answered with academic resources. So a lot of the like fundamental kind of like boundary pushing and AI science moved into companies.”
Jack Morris Jul 2, 2025 ▶ 4:22 Information Theory for Language Models: Jack Morris
Jul 2, 2025 positive
Assertion Supported
Morris: New embedding inversion model exactly recovers 90% of source text
“Like we ended up building a system that can do this quite well, like taking an embedding and I think our highlight number is like at a certain length, like a long sentence length, we can get 90% of the text back exactly.”
Jack Morris Jul 2, 2025 ▶ 26:53 Information Theory for Language Models: Jack Morris
Jul 2, 2025 neutral
Opinion
Morris: Machine learning lacks a fundamental unit of deep learning information
“I don't think we know what a bit is yet in terms of like deep learning models.”
Jack Morris Jul 2, 2025 ▶ 19:21 Information Theory for Language Models: Jack Morris
Jul 2, 2025 positive
Insight
Morris: Information in AI should be measured under computational constraints
“There's this theoretical framework proposed in this paper, which is a theory of usable information under computational constraints from 20, 20. It really doesn't have that much press. They're not aren't as many citations as you would think, but I think it's a …”
Jack Morris Jul 2, 2025 ▶ 16:30 Information Theory for Language Models: Jack Morris
Jul 2, 2025 neutral
Assertion Supported
Morris: Language models hit a hard memorization plateau regardless of dataset scaling
“Like, no matter how you scale the training size, you hit this like perfect, perfect ish plateau in auto memorization, which we call the model capacity.”
Jack Morris Jul 2, 2025 ▶ 38:32 Information Theory for Language Models: Jack Morris
Jul 2, 2025 positive
Insight
Morris: AI paradigm shifts are driven by novel datasets, not architectures
“I think, like, all of the things that I would consider paradigm shifts in the Kuhnian sense came from a new technique, but trained on new data, and I think the new data is super, super important”
Jack Morris Jul 2, 2025 ▶ 1:09:20 Information Theory for Language Models: Jack Morris
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more