Zico Kolter
21 statements across 1 episodes · 10 bullish · 3 bearish · 1 people on the record · first statement Sep 4, 2024 by Zico Kolter · across every show →
On the record as a speaker too: Zico Kolter's record, appearances and statements → this page counts the times other people say the name.
Everything said about Zico Kolter, oldest first
Sep 4, 2024 positive
Kolter: AI model performance is not plateauing in coding tasks
“The domain I use models for most probably is coding, and also doing things like transcribing lectures and stuff like this. On those tasks, I am absolutely not seeing plateauing gains. The latest models, they are notably better than the previous iteration, and …”
Sep 4, 2024
Kolter: AI model architectures and Transformers no longer matter
“I, for a lot of my career, was thinking that model architectures really mattered, and by having clever, complex architectures and sub-modules inside architectures, you would have, that was the route to sort of better AI systems. For the most part, I don't beli…”
Sep 4, 2024 bullish
Kolter: AI scaling limits are financial and practical, not physical
“I'm not really sure what the rationale is for saying that we've, we plateaued in the compute sense. Most scaling laws that I've seen certainly suggest it can keep going. It's more expensive. You could argue that it's by far just scaling is, may not be the most…”
Sep 4, 2024 neutral
Sep 4, 2024 negative
Kolter: Training custom AI models from scratch will become economically unviable
“Companies that are right now thinking about training their own models and things like this, and it's just sort of the default that of course you would do this, that this must, won't be an economically viable thing to do. In the future, and so it won't happen a…”
Sep 4, 2024 positive
Sep 4, 2024 positive
Kolter: Perceived AI plateaus stem from limited user imagination, not models
“So I think this perception has more to do with people's limited imagination of what they can do with these models, and less to do with the models themselves. But that will evolve over time. People will start figuring out you can use them for better and better …”
Sep 4, 2024
Kolter: Multimodal AI data is abundant but constrained by compute bottlenecks
“There are massive amounts of data available, And I think we have not yet figured out how to properly leverage those due to either limitations of compute. I mean, you have to process all that data and it does take, we don't have current models to do this very w…”
Sep 4, 2024
Kolter: Modern AI progress comes from uncurated web data over manual labeling
“Kind of on the contrary, I thought that data was sort of, you know, data had to be highly curated to be valuable, and the value in data came essentially from very manual labeling of this data and human intensive curation. The big amazing insight Of current AI …”
Sep 4, 2024 bullish
Sep 4, 2024 positive
Kolter: Early AI optimists have been proven right by recent progress
“And the people that have been sort of ringing this bell for a while saying, look, this is coming, this is this, you know, they've, in many cases, in my view, been proven right. And I've updated my sort of posterior beliefs based upon the evidence I've seen.”
Sep 4, 2024 positive
Kolter: Winning companies will leverage workforce with AI, not fire them
“The winners in this new world Will the companies that say survive and thrive and become dominant in this new world? Not talking about the AI companies for now, talking about sort of the rest of the companies that the ones that people worry that they're going t…”
Sep 4, 2024
Sep 4, 2024 positive
Sep 4, 2024
Sep 4, 2024 positive
Zico Kolter works almost exclusively with the largest available AI models
“I work almost exclusively with the largest models that are available to me because it just works better, and when I don't have a given task that I'm doing over and over, when I want to have that generality, I want to work with the larger models that are availa…”
Sep 4, 2024 neutral
Kolter: Machine learning algorithms fail to extract maximum data value
“What that means is our current algorithms, we are not yet maximally extracting the information from data we have. And there are way more deductions and inferences and other processes that we can apply to our current data to provide more value.”
Sep 4, 2024 negative
Kolter: Detailed AI regulations become outdated within months
“A lot of the details about how those regulations sometimes evolve can be a bit misguided or miss the point or somehow Just when I read them, basically they're going to become dated in, in a matter of months, because they're dealing with things and they're appr…”
Sep 4, 2024 positive
Kolter: AI safety is a necessary condition for using AI
“I want to develop and improve safety of these tools Because I want to use them. It's not that we have some moral imperative that we have to develop these tools. I mean, maybe there are, or we have to develop AI and AGI. Maybe that's true. But that's not what m…”
Sep 4, 2024 negative
Kolter: Extreme certainty on either side of AGI debate is unwarranted
“The thing that frustrates me most, honestly speaking, is the degree of certainty that some people have about whether we will definitely get there very, very soon or even more on the flip side, that there's absolutely no way that we will ever achieve AGI with t…”