Opinion certainty 4/5 debate potential 3/5

Smith: Legacy orchestration layers bottleneck modern GPUs like Nvidia H100s

Todd Smith · Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure · Apr 29, 2025 · at 12:19

Todd Smith, CEO of OpnBook, argues that infrastructure software scheduling rather than chip hardware limits data center performance.

0:00 / 0:19exact quote · 19.5s
720p mp4 · rendered on demand · StarZero watermark
“Reality is whether you have an older stack or if you have even maybe the newest NVIDIA's newest H 100 in your environment, regardless of what they are, they're being choked out a little bit by these old world or these legacy orchestration and scheduling layers.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Todd Smith

Assertion Partly supported
Smith: Data center compute hardware sits idle roughly 40% of the time
“You find that that entire compute stack in that whole facility on average is really only being used approximately 54% of the time, meaning About 40% of the time, all of that hardware is sitting in an idle state.”
Todd Smith Apr 29, 2025 ▶ 10:49 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Insight
Smith: Founders Should Demand Real-Time Feedback During the First Pitch
“It's important to hold them accountable to that time. We're both donating our time to this discussion, holding them accountable to provide you some real feedback, even in the moment if you can do it, it's, it, you're better off pushing yourself to do it and le…”
Todd Smith Apr 29, 2025 ▶ 31:56 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Insight
Todd Smith: Infrastructure engineers avoid new tech to protect vesting equity
“This product, right this product is very attractive, or more attractive, easier to sell from a top-down perspective today. It's new tech. It's brand new tech that so nobody is an expert leveraging this tech yet, and there's a lot of experts out there that are …”
Todd Smith Apr 29, 2025 ▶ 34:16 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Opinion
Smith: Hardware manufacturers cannot keep up with high-performance computing demands
“We see a lot of those hardware manufacturers of GPU and other data center hardware just blazing a trail today. we're really happy that they're building better solutions, but the reality is they can't keep up with high performance computing needs today.”
Todd Smith Apr 29, 2025 ▶ 1:19 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Assertion Not checkable as stated
Smith: TAHO software unlocks existing hardware without requiring new data centers
“All of those high performance computing companies would be able to leverage this product, this Tahoe, the software infrastructure product, in order to really unleash the capabilities of their existing hardware without having to go get new hardware or even buil…”
Todd Smith Apr 29, 2025 ▶ 6:09 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Insight
Smith: Compute infrastructure unlocks top-line revenue whereas BI merely targets bottom-line costs
“The BI tool is a bottom line driver. Whereas when you provide more compute capabilities to a company, that's a that's a productivity and top line driver. It can be a bottom line driver because it can drive for efficiencies on the, on those infrastructure cost …”
Todd Smith Apr 29, 2025 ▶ 18:05 Harnessing High-Performance Computing: Todd Smith’s Vision for OpnBook’s TAHO Infrastructure
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.