CARBS, every mention
10 scenes across 2 shows · ← back to CARBS
tap a year for its mentions
Latent Space 18
the MAD Podcast 4
every year every show Latent Space 18 the MAD Podcast 4
Verbatim, from the transcripts: passages where CARBS comes up on Latent Space, the MAD Podcast
State of the Art: Training 70B LLMs on 10,000 H100 clusters
- ▶ 8:17 Josh Albrecht And then the third thing is carbs, our hyperparameter, our cost aware hyperparameter optimizer, which was especially helpful for being able to experiment in much smaller scales and then scale those experiments up to the much larger scale…
- ▶ 46:22 unnamed speaker Um, I wanted to go into carbs, um, since like, that's like kind of the next layer of the stack.
- ▶ 46:27 unnamed speaker Um, we talked about carbs in the first episode with Kanjin because you've actually had a blog post about it like a couple of years ago. 6 times in the scene
- ▶ 51:59 Josh Albrecht And so carbs actually control what is the mix of data that we want to see, like how much code, you know, how much internet text, et cetera, uh, in order to figure out what is the best optimal mix of data. 2 times in the scene
- ▶ 55:39 unnamed speaker Doesn't emergence throw a spanner node theory of carbs? 3 times in the scene
- ▶ 57:56 unnamed speaker Um, so carbs, we already mentioned, um, you know, leans heavily on, uh, the sort of end evals that we would typically eval LMs on, except that you had to make your own.
Why AI Agents Don't Work (yet) - with Kanjun Qiu of Imbue
- ▶ 16:39 Kanjun Qiu CARBS, our hyperparameter optimizer, came from Abe trying to automate his own research process, uh, doing hyperparameter optimization, and he actually pulled some ideas from plasma physics, he's a plasma physicist, to make the local search…
- ▶ 57:17 Kanjun Qiu Um, like the curiosity led us to, uh, build carbs, for example, uh, this hyperparameter optimizer. 3 times in the scene
Building Human-Level AI Agents: Imbue CEO Kanjun Qiu on the Road to General Intelligence
- ▶ 19:00 Matt Turck I read, I think you guys wrote a, a, a post a little while back about, a little while back, a few weeks ago, I guess in the, in the era of generative AI every, you know, a few weeks ago, a little while back, um, about a system called… 3 times in the scene
- ▶ 32:39 Kanjun Qiu Like the reason we have carbs is because Abe was a plasma physicist and he applied some ideas from plasma physics, physics to make this local search algorithm work well.