Sandboxes
topic on 3 shows · 10 statements across 6 episodes
Latent Space 
the MAD Podcast 
20VC
10 statements about Sandboxes, every show
Murdock: Containers are not safe for AI tools and require sandboxes
“Containers aren't safe. You need sandboxes. This is why. The big container company, Docker said, Hey, themselves said containers aren't safe. You better put in a sandbox.”
Murdock: There will be thousands of specialized forms of sandboxes for AI
“The truth is, there's gonna be thousands of different forms of sandboxes, and you're gonna need a company that understands how models look at tools, and what that behavior is, and be able to take that behavior and optimize for it.”
Murdock: E2B and Docker lead in understanding AI sandbox infrastructure
“And if you look at E to B and you look at Docker, they're probably the two best at understanding all that stuff. So you start there because if you don't get the sandbox right, forget everything else.”
Bubna: Modal built agent sandboxes and published smol-developer recursive loops early
“We built sandboxes in May of the year before anyone knew this was going to be a thing. And the first example we published was we took a small developer and put in a loop so the agent can iterate on itself.”
Bubna: RL Rollouts Are Extremely Bursty and Can Require 100,000 Sandboxes
“RL is insanely bursty. Like when you're doing rollouts you sometimes need a 100,000 sandboxes.”
Burazin: Daytona sandboxes dynamically resize memory on the fly
“We haven't got into features, but an interesting feature is that it's very hard to OOM or out of memory, our sandboxes, because we can dynamically on the flyer resize, which is like impossible on almost any other thing.”
Burazin: Sandboxes running over 24 hours represent 2.5% of volume, 20% of revenue
“Two and a half percent of our sandboxes run longer than 24 hours, but it's a large percentage, like twenty-ish percent of revenue.”
Mlejnsky: Agent sandboxes are general code runtimes, not just interpreters
“Yeah, I think it's a good idea to stop thinking about a sentence was just for code interpreting. And more about like a runtime, code runtime for the LLM, or the agent. The use case for the sandbox, it's a very horizontal in a sense that it can cover everything…”
Mlejnsky: LLMs will soon configure and provision their own cloud sandboxes
“And the goal where we think this is getting going is the LLM like decides what it wants to do and how it wants to have the sandbox configured. So it's basically starts controlling the infrastructure itself and creating sandboxes themselves.”
Modal's Sandbox Feature Is Evolving Into a Platform for Platforms
“The core, like, container infrastructure we offer could actually be, like, you know, unbundled from, like, the client SDK and offered to, like, other, you know, like, we're talking to a couple of, like other companies that want to run, you know, through their,…”