CARBS
3 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Oct 21, 2023 by Kanjun Qiu · said 18 times in 2 episodes since 2023 · across every show →
Mentions by year
brought up most by Kanjun Qiu (4), Josh Albrecht (3)
tap a year for its mentions
2024 14 mentions in 1 episode
2023 4 mentions in 1 episode
Everything said about CARBS, oldest first
Oct 21, 2023 neutral
Imbue's CARBS hyperparameter optimizer originated from plasma physics concepts
“CARBS, our hyperparameter optimizer, came from Abe trying to automate his own research process doing hyperparameter optimization, and he actually pulled some ideas from plasma physics, he's a plasma physicist, to make the local search work.”
Jun 25, 2024 positive
Albrecht: CARBS models compute cost per sample for hyperparameter search
“CARBS is, it's maybe a backronym, but it's for Cost Aware Pareto Region Bayesian Search... The point is that it's a cost aware hyperparameter tuner. So most hyperparameter tuners you kind of say, okay, here's this objective function. I want you to make this nu…”
Jun 25, 2024 positive
Albrecht: Cost-aware tuning reveals scaling laws for all hyperparameters
“So by doing that, we can see the scaling laws or not just, you know, the scaling laws from like the, you know, chinchilla paper, the scaling laws for all parameters. We can see how does the number of layers change with this? How does the You know, the learning…”