Akshat Bubna
CTO and Co-founder, Modal · 1 appearance on the record.
computed by AI from the episodes · how this works → · full disclaimer →
founderexecutiveengineer
Akshat Bubna is the co-founder and CTO of Modal. The serverless cloud infrastructure platform provides fast container runtimes, GPU inference, and sandboxed execution environments for AI applications and agents.
40statements → 12claims → 4claims resolved → 100%fully supported → 3.83/5average certainty → 1.68/5average debate potential → 4said about them ↓
4 supported 0 partly supported 0 contradicted 1 not yet assessed 7 not checkable as stated how the 12 claims stand · each chip opens the sources
2 predictions · 10 assertions · 3 opinions · 11 insights · 14 disclosures · every statement was checked. The predictions and assertions are the 12 claims: statements the public record can support or contradict. 4 are resolved, 1 is not yet assessed, and 7 name no date, number or outcome precise enough to check. Everything else (opinions, insights, what ifs, disclosures) can never be settled by the record, so it carries no assessment.
The record, in short
What the tape says about how Akshat argues and how the claims held up. Everything they said, and everything said about them, is in the tabs below.
Their most notable supported claim
Bubna: Open-source DFlash matches proprietary speculative decoding performance
“Recently we shared our work on dflash, which is a block-based speculator, and we've open sourced all of it, so you can get, by using open source dflash, you can get the same performance as you would with one of the proprietary providers.”
Expressed certainty vs assessment result
weighted support: a fully supported claim counts one, a partly supported claim counts half. Each filled bar is clickable and opens exactly those claims; "none yet" means nothing said at that certainty level has resolved yet
Everything Akshat Bubna said on Latent Space that made the record, most notable first. Filter by type, assessment or year in the ledger →
Bubna: Speculative decoding accept length delivers multiplicative speedups over kernel tuning
“People talk a lot about, we made these kernels faster and whatnot, but improving kernel only give you like a few percentage points of improvement and increasing except length literally is a multiplicative decrease.”
Bubna: Kubernetes lacks burstiness support and has terrible developer experience
“Kubernetes is hard to manage. It's not built for burstiness and custom images and has a terrible developer experience.”
Bubna: System Observability Is Becoming More Important Than Reading Code
“You still need humans to go interpret what's going on and you know, make judgment calls and whatnot. And that's, I feel like maybe more important now than looking at the code itself.”
Bubna: Open-source DFlash matches proprietary speculative decoding performance
“Recently we shared our work on dflash, which is a block-based speculator, and we've open sourced all of it, so you can get, by using open source dflash, you can get the same performance as you would with one of the proprietary providers.”
Bubna: Sandboxes Require Hard Boundaries, Not LLM-Mediated Permissions
“I'm skeptical of LLM-mediated permissions for stuff that is At the sandbox level, because you do want hard boundaries. Otherwise, obviously someone can exfiltrate stuff.”
Bubna: Model APIs primarily serve a less sticky hobbyist market
“This is one thing we've kind of stayed away from is providing an API for models, because I think providing Model APIs is, some of it ends up serving like a really hobbyist market, which is much less sticky.”
Bubna: Modal built decorators to eliminate YAML and make infra dynamic
“That, that, that was really important because we really didn't want people to spend so much time writing YAML, and it seemed like you could really condense the surface area of what you're doing put it in code so you can actually operate on it, just like you ca…”
Bubna: Agent Experience Benefits From Typed Decorators Over Kubernetes YAML
“We think that the same benefits that apply for DX also actually apply for AX, which is why would you have an agent read through hundreds of Kubernetes files and, like, write YAML that's not even typed when it can basically make a couple of changes in a decorat…”
Bubna: Modal's Biggest Use Case and Initial PMF Was Custom Non-LLM Inference
“Our biggest use case actually is elastic inference. And the thing we first found product market fit with was inference for custom models. So we kind of stayed away from the LM space and we were serving companies like Suno for audio, Runway for video, robotics …”
Bubna: RL Rollouts Are Extremely Bursty and Can Require 100,000 Sandboxes
“RL is insanely bursty. Like when you're doing rollouts you sometimes need a 100,000 sandboxes.”
Modal CTO: Production AI inference is difficult due to tail latency
“Running production grade inference is a hard and fair problem. Even if you subtract out the auto scaling, it's controlling things like tail latency and making sure every request is delivered at least once and whatnot.”
Bubna: Modal operates zero data centers, running entirely on NeoClouds
“We don't have our own data centers. We just run across a lot of Neo clouds.”
Bubna: Modal's custom reliability layer insulates users from GPU hardware drops
“That's why it's something we've invested a lot of time in is actually building our own reliability layer on top. So if the GPU falls off the bus or something happens, we user workloads are not affected.”
Bubna: Modal uses eBPF-filtered TCP rather than VPN encryption for internal networking
“This is TCP, and we have eBPF programs that will reject or allow the TCP connection based on whether you're allowed to do it.”
Bubna: Auto-research is hyperparameter tuning guided by model intuition, not architecture changes
“I, so the stuff I've seen people do with it is nowhere on the architecture level. It's pretty much tweaking parameters, but it's basically a high proprietor sweep that's guided by some sort of model intuition. So it's like much more efficient than whatever oth…”
Bubna: AI agents struggle to reason through logs and observability
“I think the things that sometimes agents struggle with without right guidance and a skill is how to use the rest of our observability. Like, how to, something is failing, like, How do you look at the logs and then update the right thing? It's sort of reasoning…”
Bubna: Batch compute demand comes mainly from non-LLM workloads like computational biology
“The demand that we see for something like that is actually not for LLMs. Although sometimes people want to run evals and do synthetic data prep and there it makes sense. But it's from a lot of non LLM companies like people who are doing computational bio, like…”
Bubna: Thousands more companies will post-train and deploy open-source models
“I think for example, LM inference, thousands more companies are going to post train their own models and deploy open source models for inference.”
Bubna: Production AI agents require specialized sandboxes for compute and networking control
“You need a lot more control over your compute primitive on things like what sort of, how do you persist different files that the agent has access to, and how do you snapshot and restore? How do you control the networking? Maybe you want GPUs. When you get to t…”
Modal CTO: Suno runs 100% of inference on Modal
“They use modal for all their inference, and that's because they have like a custom, they have completely custom model architecture, and that means that they have to be at the code level and tweak things that are not Yeah, it's an API.”
Bubna: Modal is bullish on CI as coding agents run more tests
“We're very bullish and modal on the CI market as well because it has, There's more agents coding agents they're gonna run a lot more CI, and the preventives there can be much better.”
Bubna: AI Agent Developers Prefer TypeScript Over Python
“And the interesting thing with, like, the agent stuff is people use their TypeScript SDK a lot more because they're not actually doing anything that needs ML.”
The other half of the tape: Akshat Bubna's own voice is left out of every number here. Other people bring the name up 4 times in 1 episode on Latent Space. every mention, with the transcript →
Who brings them up most Shawn Wang 4
Every mention by year
tap a year for its mentions
2024 4 mentions in 1 episode
Appearances (1)
| Episode | Date | Speaking time |
|---|---|---|
| The Future of AI Infra: from Kubernetes to Agent Sandboxes — Akshat Bubna, Modal CTO | Jul 8, 2026 | 30m |