AI Engineering

“I had seen basically front-end engineering become its own professionalized fields with dedicated conferences, dedicated influencers, and tech stacks and all those things, and I've seen the same thing for cloud engineering and data engineering. And all that. An…”

“This is homebrew computer club. You know, the moment when the Apple one came out, like The Apple one created by Steve Jobs and Steve Wozniak was a breadboard inside, like literally a wooden case hammered together with like nails and duct tape, you know? And if…”

“I think it could be that TypeScript is going to win AI engineering, and that's something I haven't anticipated or seen, or I don't even know how to sort of Position around this, because I think it really does mean a lot of different things for what frameworks …”

“So like, I think the new hello world of AI engineering is going to be building your own claw.”

“We should be adding structure necessary to get things to work today, but keeping an eye on improving models and keep, but keeping a close eye on models, improving rapidly and removing structure in order to un-bottleneck ourselves.”

“And actually, so actually my biggest job to enable AI is not AI engineering. It's old school engineering, exposing all this, these, this data that we have so that you can have a reasoning engine reason for you as a product person, or actually for me as a consu…”

“The other thing is I think that AI engineering Evaluation or evals here is actually different from MLOps or ML evaluation for traditional ML models. We were in a much more, you know, data rich setting in MLOps. So we were taught to come up with loss metrics or…”

“The reason that AI engineering can exist outside of the model labs is because the model labs release Models with capabilities that they don't even fully know because you never train specifically for it. It's emergent. And you can rely on basically crowdsourcin…”

“The real gap is that software engineers who have a particular way of thinking, a particular set of biases, a particular type of workflow that they run, are going to be the ones who are doing AI engineering, and that the tools that were built for ML are fantast…”

“Our core belief is that if you embrace evaluation as The sort of core workflow in AI engineering, meaning every time you make a change, you evaluate it, and you use that to drive the next set of changes that you make, then you're able to build much, much bette…”

“I think it kind of represents the future of AI engineering, one where You can spend a lot of time writing English and sort of crafting the use case itself. You can reuse tools across different use cases. And then most importantly, the development process is ve…”

“And I know exactly the behavior of the system that I've built will be. But the cool thing about AI is that every day you come to work and you make some tweaks to the model. And what you get on the other end is actually somewhat unpredictable. Like you kind of …”

“I think the fault first mindset and the ML curiosity attitude could be somewhat in tension, right? Because for example, the stereotypical, stereotypical version of someone that is great at building fault tolerant systems has probably been doing it for a decade…”