sandboxes

“The core, like, container infrastructure we offer could actually be, like, you know, unbundled from, like, the client SDK and offered to, like, other, you know, like, we're talking to a couple of, like other companies that want to run, you know, through their,…”

“And the goal where we think this is getting going is the LLM like decides what it wants to do and how it wants to have the sandbox configured. So it's basically starts controlling the infrastructure itself and creating sandboxes themselves.”

“Yeah, I think it's a good idea to stop thinking about a sentence was just for code interpreting. And more about like a runtime, code runtime for the LLM, or the agent. The use case for the sandbox, it's a very horizontal in a sense that it can cover everything…”

“We haven't got into features, but an interesting feature is that it's very hard to OOM or out of memory, our sandboxes, because we can dynamically on the flyer resize, which is like impossible on almost any other thing.”

“We built sandboxes in May of the year before anyone knew this was going to be a thing. And the first example we published was we took a small developer and put in a loop so the agent can iterate on itself.”

“RL is insanely bursty. Like when you're doing rollouts you sometimes need a 100,000 sandboxes.”