CARBS
topic on 4 shows · 6 statements across 5 episodes · said 22 times in 3 episodes since 2023
Latent Space 18 
the MAD Podcast 4 
the Knowledge Project 
BigDeal
Mentions by year, every show
tap a year for its mentions
Latent Space 18the MAD Podcast 4
2024 14 mentions in 1 episode
2023 8 mentions in 2 episodes 4 per episode
every mention on every show, scene by scene, with the transcript →
6 statements about CARBS, every show
Lyon: Average American Consumes 300g Carbs Daily vs 130g Recommendation
“The average American is eating around 300 grams or so of carbs a day. The recommendation is a 130 grams.”
Albrecht: CARBS models compute cost per sample for hyperparameter search
“CARBS is, it's maybe a backronym, but it's for Cost Aware Pareto Region Bayesian Search... The point is that it's a cost aware hyperparameter tuner. So most hyperparameter tuners you kind of say, okay, here's this objective function. I want you to make this nu…”
Albrecht: Cost-aware tuning reveals scaling laws for all hyperparameters
“So by doing that, we can see the scaling laws or not just, you know, the scaling laws from like the, you know, chinchilla paper, the scaling laws for all parameters. We can see how does the number of layers change with this? How does the You know, the learning…”
Imbue's CARBS hyperparameter optimizer originated from plasma physics concepts
“CARBS, our hyperparameter optimizer, came from Abe trying to automate his own research process doing hyperparameter optimization, and he actually pulled some ideas from plasma physics, he's a plasma physicist, to make the local search work.”
Imbue used plasma physics principles to build its CARBS search algorithm
“Like the reason we have carbs is because Abe was a plasma physicist and he applied some ideas from plasma physics, physics to make this local search algorithm work well.”