Models Today
topic on 3 shows · 3 statements across 3 episodes
the a16z Podcast 
Big Technology 
20VC
3 statements about Models Today, every show
Sherman Wu: Current AI models cannot reliably execute exact multi-step instructions
“The models today, just like maybe in some future world instruction following would be so good that you just like ask it to do this four step process. And it like always does the four step process exactly. We're still not there yet.”
Edwin Chen: AI Cannot Write 50% of Meaningful Enterprise Code
“I don't think models today can write 50% of the code and, you know, come up with 50% of the ideas that, that people are, that are actually going to be meaningful to your company.”
Wang: Current AI models invariably fail when chaining multi-step actions
“One of the things that really is true in all the models today is that they're not that good at, you know at taking multi-step actions. Whenever it has to take a few hops, whenever it has to take, chain a few things together, it'll invariably make mistakes alon…”