Mlejnsky: Hugging Face uses E2B sandboxes during Open-R1 RL training
Vasek Mlejnsky · Why Every Agent needs Open Source Cloud Sandboxes · Apr 24, 2025 · at 55:04
Vasek Mlejnsky is the co-founder of E2B, a cloud sandbox platform for AI agents, discussing enterprise and research use cases with Latent Space hosts.
“The way HuggingFace, who built the OpenROne project is using us is during like the reinforcement learn, code gen reinforcement learning step where the ROne model the OpenROne model has a training step where they give it a Code problem, and the model needs to generate and run code somewhere. Then you have reward function basically giving you zero or one, telling you if that was a good solution or bad solution, then you improve the model. So kind of like the feedback loop. They are using the EtoB sandboxes to, you know, run many hundreds of these sandboxes, thousands of these sandboxes per training step.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →