Software Stack
topic on 2 shows · 3 statements across 3 episodes
3 statements about Software Stack, every show
O'Driscoll: Owning AI model layers matters more than building custom chips
“If you think about it, if you're up here in the software stack, it's more important to own one level down, which is that model layer than to kind of start to optimize around chips.”
Scott: Software optimizations drive AI inference efficiency far more than hardware
“A little bit of that is because you get, you know, maybe like a two X benefit price performance from hardware every generation. Like if you're lucky but you get a much bigger improvement price performance wise from. All of the things that you're doing in the s…”
Enterprise buyers distrust all-in-one platforms over products that integrate well
“The last thing an enterprise wants to hear is, oh, here's a thing that does everything and promises heaven. It promises that it can do, solve every, every single one of your problems. Folks are just so tuned out of that narrative. It's much better to say, we d…”