Dr. Ben Lee

6 statements across 1 episodes · 3 bullish · 2 bearish · 1 people on the record · first statement Dec 18, 2025 by Dr. Ben Lee · across every show →

On the record as a speaker too: Dr. Ben Lee's record, appearances and statements → this page counts the times other people say the name.

Everything said about Dr. Ben Lee, oldest first

Dec 18, 2025 bullish
Prediction Open · timeframe Dec 2030
Software agents, rather than human queries, will drive most AI inference workloads
“I think increasingly most of the inference workload will come from other software agents.”
Dr. Ben Lee Dec 18, 2025 ▶ 46:40 Will inference move to the edge?
Dec 18, 2025 bearish
Insight
Shifting inference to edge data centers will reduce efficiency and increase energy costs
“I think as you shrink the system down, you will get, you will lose an efficiency. You will be trying to build these 20 megawatt data centers and maybe footprints or facilities that weren't designed initially for those workloads. So yes, I think total energy co…”
Dr. Ben Lee Dec 18, 2025 ▶ 45:48 Will inference move to the edge?
Dec 18, 2025 bullish
Prediction Not checkable as stated
Competition on AI latency will force local GPU deployments in major markets
“I think the catch there will be if one of these model providers or one of these application developers makes performance a distinguishing feature of their offering, right? If they start competing on performance rather than on capability, then we're going to se…”
Dr. Ben Lee Dec 18, 2025 ▶ 33:26 Will inference move to the edge?
Dec 18, 2025 bullish
Prediction Not checkable as stated
Siting distributed edge compute will become easier than 1GW data centers
“I think finding capacity there may eventually become easier than finding the next thousand megawatts.”
Dr. Ben Lee Dec 18, 2025 ▶ 25:40 Will inference move to the edge?
Dec 18, 2025 neutral
Insight
LLM inference prompts are processed locally on one to eight GPUs
“When you send a prompt to for processing by a large language model, that prompt is probably handled by one GPU or maybe Eight GPUs inside a single machine. So, and the reason that is, is because the model sits in that machine, the data sits in that machine, an…”
Dr. Ben Lee Dec 18, 2025 ▶ 22:17 Will inference move to the edge?
Dec 18, 2025 bearish
Prediction Not checkable as stated
If AI scaling slows, repurposed central GPUs will cannibalize edge data centers
“And if it turns out that maybe there are diminishing returns from training larger and larger models, or maybe we run out of data because we've exhausted all the data that's available on the internet. When those things happen, it may be that demand for these GP…”
Dr. Ben Lee Dec 18, 2025 ▶ 32:52 Will inference move to the edge?
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.