Prometheus, every mention
3 scenes · ← back to Prometheus
tap a year for its mentions
every year anyone Nathan Lambert 1Josh Albrecht 1
Verbatim, from the transcripts: the passages where Prometheus comes up
Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI
- ▶ 46:03 unnamed speaker But we're like, as developers, we're used to calling out to different systems, but here you use the open source things like the Prometheus, whatever, and you run it locally so that you can have the full loop, right?
The State of Reasoning — from Nathan Lambert, Interconnects/AI2 [LS Live @ NeurIPS 2024]
- ▶ 13:25 Nathan Lambert Um, well, we already have a bunch of open models that are doing like, um, like judge of models and Prometheus and other things that are designed specifically for LM as a judge.
State of the Art: Training 70B LLMs on 10,000 H100 clusters
- ▶ 20:24 Josh Albrecht We have tons of tooling around like, you know, Prometheus and, and all sorts of other, uh, tools for understanding what's going on in these machines, because you don't want to be like logging into each one and looking at the temperature or…