Jerry Tworek
17 statements across 1 episodes · 6 bullish · 2 bearish · 1 people on the record · first statement Oct 16, 2025 by Jerry Tworek · across every show →
On the record as a speaker too: Jerry Tworek's record, appearances and statements → this page counts the times other people say the name.
Everything said about Jerry Tworek, oldest first
Oct 16, 2025 positive
Oct 16, 2025 negative
Tworek: Top-down management does not work in AI research organizations
“Top down structuring of research doesn't work in research organizations. I really don't believe in it because like you are not kind of hiring some of the smartest people in the world and open air has incredibly, incredibly smart people. To kind of tell them wh…”
Oct 16, 2025
Oct 16, 2025 positive
Tworek: Pre-Training on Unlabeled Data Yields Far More Intelligence Than Supervised Mapping
“There are many more bits usually in the targets than in the labels and studying the structure of targets itself. It yields much more learning and much more intelligence than learning the mapping itself. So like spending a whole compute on just learning the dat…”
Oct 16, 2025 positive
Oct 16, 2025 neutral
Tworek: AI reasoning spent on unknown answers yields better results with time
“I think that, that, that difference is here, like answering a question usually means you already know the answer and you just elicit the answer, you know, and the process of reasoning is Getting to the answer that you don't know, and usually the longer you spe…”
Oct 16, 2025 positive
Oct 16, 2025 positive
Tworek: Uninformed researchers pose a greater risk than IP leaks
“It is like, yeah, it is some like risk of losing IP, but I think the risk of not doing the right thing and of people not being informed about research and not being able to do the best research is much higher in my personal opinion and how, how I approach thos…”
Oct 16, 2025 neutral
Tworek: Lack of pre-training was the primary bottleneck for 2019 RL
“Like whenever, even when I started like 20, 2019, the reinforcement learning was kind of fashionable at that moment, although not like very successful, but we were, the reinforcement learning was able to solve a lot of games, but the bottleneck was there that …”
Oct 16, 2025
Tworek: AI alignment is a never-ending pursuit as human goals evolve
“And it's I think it's a never ending pursuit because like, even, even for humans, it's not super easy to define what's, what do we consider a light? And I think as our civilization will evolve, it will, the notion of alignment and the goals of humanity will, K…”
Oct 16, 2025 neutral
Tworek: OpenAI focuses research on only three or four large-scale projects
“We all work on a very few projects total. There are not that many projects. OpenAI is not trying to do everything. We are not trying to like have portfolio. We are trying to have like multiple different bets. Always the idea is we do a few core things really, …”
Oct 16, 2025
Jerry Tworek: Pre-training AI models is mathematically simple compared to RL
“The first thing that is important to know and understand, RL is hard. Like, conceptually, if you think about it, and there's still a lot of depth to it, but very conceptually, mathematically speaking, pre-training is dead simple.”
Oct 16, 2025 neutral
Tworek: Calling LLMs strictly next-token predictors is inaccurate in RL era
“Language models do on their own, like fundamental level is they are often called as next token prediction machines. And that's not completely accurate in the age of reinforcement learning, but they still operate on mostly on tokens that are mostly text.”
Oct 16, 2025 neutral
Tworek: Ilya Sutskever set OpenAI's current RL research roadmap in 2019
“And what he said at the beginning of 2019 was to train large generative model on all data we can and then do reinforcement learning on it. That was the OpenAI research Plan at the beginning of 2019. And this is exactly what we are doing today.”
Oct 16, 2025 neutral
Tworek: Pre-training and RL are necessary for AGI, but not sufficient
“I generally think something that we are doing, like, pre-training today is necessary. I think something that, like, we are doing RL today is necessary, and there will surely be a few things more, and like, we have a lot of, Very ambitious research programs on …”
Oct 16, 2025 positive