Jeff Schmidt

7 statements across 1 episodes · 4 bullish · 1 bearish · 1 people on the record · first statement Oct 1, 2024 by Jeff Schmidt · across every show →

On the record as a speaker too: Jeff Schmidt's record, appearances and statements → this page counts the times other people say the name.

Everything said about Jeff Schmidt, oldest first

Oct 1, 2024 bullish
Prediction Not checkable as stated
Schmidt: DisTrO will eliminate data centers' InfiniBand dependency before edge AI dominates
“I think there's, you know, immediately coming out. What you'll see is the ability for even centralized actors who might have multiple data centers to now, like just use them in a more efficient way. Like just have N equals two, you know, like anything. And eac…”
Jeff Schmidt Oct 1, 2024 ▶ 1:09:20 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024 positive
Insight
Schmidt: AI industry relies on outdated 1990s architecture assumptions ripe for disruption
“It turns out that most assumptions in the AI space right now are a product of that's just how things had been done when there was not nearly as much energy and attention to it. So someone made an assumption maybe in the early nineties that everyone just kind o…”
Jeff Schmidt Oct 1, 2024 ▶ 15:48 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024 positive
Insight
Jeff Schmidt: AI Research Offers Unprecedented Green Field for Groundbreaking Discoveries
“We're lucky right now because the state of AI as a science is incredibly new, and it truly has a wide green field. And unlike lots of other areas of science where if you look at something and you think, why hasn't somebody done X, Y, and Z? Unfortunately, ofte…”
Jeff Schmidt Oct 1, 2024 ▶ 2:50 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024 bullish
Insight
Schmidt: Sharing only key signals in distributed training yields equivalent model learning
“We know that like what we, what needs to be communicated between these things, the two, the different nodes are just these few key pieces of information. And that is necessary. That is a necessary condition or rather a sufficient condition To get the equivalen…”
Jeff Schmidt Oct 1, 2024 ▶ 32:42 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024
Assertion Not checkable as stated
Schmidt: ChatGPT, Llama, and DeepSeek use Nous Research's YaRN context extension
“Bone here is the lead author of a method we developed called YARN, which is a context window extension method that we released and did the research on. It is now used by every, every model you use nowadays, everything, everything Chachipiti, Lama, DeepSeq, all…”
Jeff Schmidt Oct 1, 2024 ▶ 12:18 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024
Assertion Not checkable as stated
Schmidt: Fewer than ten organizations worldwide can train Llama-scale AI models
“Yeah, I mean, I would, it would probably be in the number of ones on my hand and it probably wouldn't use all my fingers, you know. Yeah, I mean, you basically have, OpenA, Anthropic, Meta, X, Google, and then you have a few Mistral, and then Deep Seek and a c…”
Jeff Schmidt Oct 1, 2024 ▶ 25:00 The Quest for Community-Trained Open Source AI Models
Oct 1, 2024 negative
Assertion Supported
Schmidt: Current AI training requires all GPUs in the same datacenter
“When it comes to training models, the current paradigm for training models requires that all of the GPUs that train the model, these, you know, these computers that do the training, they all have to be like in the same room.”
Jeff Schmidt Oct 1, 2024 ▶ 14:23 The Quest for Community-Trained Open Source AI Models
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.