The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 11 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Tworek: Traditional human data labeling is becoming obsolete as models advance
“I think, like, in a way, I think it's getting more and more to be a thing of the past as the models are getting smarter and smarter. This is becoming less of a thing, but I think a few years back, and especially in GPT-IV days, this was the thing.”
Tworek: Coding agents are the first successful agentic AI products
“Like, coding agents are at the moment the first, like, pretty successful agentic products built on top of AI.”
Tworek: OpenAI's o1 release caught US AI labs unprepared for RL
“As far as I know, like our O-one release mostly caught a lot of us labs by surprise. They didn't have like similarly advanced RL research program to my knowledge, basically no one.”
Tworek: Pre-training and RL are necessary for AGI, but not sufficient
“I generally think something that we are doing, like, pre-training today is necessary. I think something that, like, we are doing RL today is necessary, and there will surely be a few things more, and like, we have a lot of, Very ambitious research programs on …”
Tworek: Ilya Sutskever set OpenAI's current RL research roadmap in 2019
“And what he said at the beginning of 2019 was to train large generative model on all data we can and then do reinforcement learning on it. That was the OpenAI research Plan at the beginning of 2019. And this is exactly what we are doing today.”
Tworek: OpenAI internal models can currently reason for hours on tasks
“The models I can think for, like, 30 minutes, hour, two hours these days on certain, certain types of Tasks and problems like even, even, even longer than that.”
Tworek: Dexterous manipulation remains an elusive challenge for AI policies
“The project I was working on was focused on dexterous manipulation, which was back then and still continues to be an elusive challenge for trained policies.”
Tworek: OpenAI's research division consists of slightly under 600 people
“The truth is in research at OpenAI, which is like around, like slightly less than 600 people at the moment, everyone knows everything really, really it does.”
Tworek: Lack of pre-training was the primary bottleneck for 2019 RL
“Like whenever, even when I started like 20, 2019, the reinforcement learning was kind of fashionable at that moment, although not like very successful, but we were, the reinforcement learning was able to solve a lot of games, but the bottleneck was there that …”
Tworek: OpenAI internal teams heavily use Codex for coding
“We definitely use codecs a lot for coding, and this is only getting, getting better.”
Tworek: OpenAI placed second in AtCoder behind a former employee
“We did also like IOI, International Olympic Informatics earlier this year, and Adcoder Heuristics competition as well, where we went second, we, behind a single human that is also a Polish person that used to be employed by OpenAI some time ago.”