Insight
Off-the-shelf AI fails because complex architectures require full-stack joint optimization
“We are in, in my mind, Past a system integration view of the world where you simply say, I bring this in here, I bring this in here, I tie them together and do it. I'll give you an example that's very old, ah, from speech recognition and machine translation, l…”
Insight
Enterprises must deeply customize AI models on proprietary data
“In order for you to truly bring all of that to life for your customers, you have to bring your own data to the models. In a way that you can do deep customization of those models so that you truly unlock the value in that data for the products and services tha…”
Insight
Baking static context directly into models outperforms relying on dynamic prompting
“One of the best ways to bring the right context to the models is actually to do a deep customization of the models. Not all context is dynamic. A lot of context is also, you know, changes at a much slower rate. That context being baked into the model makes the…”
Disclosure
Capital One's AI pilot success rate defies the 95% industry failure average
“That's about as far away from our experience as it could be. The, that study that, that would, that, that, that you're talking about.”
Assertion Not checkable as stated
Cloud GPUs lack elasticity and availability remains a persistent challenge
“GPUs, as you know, are still not elastic. In fact, they're often, you know, availability itself is, can be a challenge.”
Insight
Agentic AI combines reasoning with model specialization for complex workflows
“Agentic AI, at least the way we look at it, is the is the bringing together of two of the most powerful forces in generative AI today. One is the power of reasoning, and the other is the power of specialization, and so agentic AI uses reasoning to break comple…”
Insight
Reframing generative AI as agentic workflows bridges lab-to-production gaps
“Casting what seems like generative AI problems into agentic problems has allowed us to bridge the gap between the lab and production.”
Insight
The most satisfying customer service experiences retain a human in the loop
“The most satisfying experience always have a human in the loop at some point.”
Insight
The vast majority of AI performance gains occur post-production
“Building something in the, ah, in your engineering environment and then taking it to production is one step of it. Ah, what I've come to recognize is that's the first step in the AI stairway to heaven. Right? A lot of the action, a lot of the learning is actua…”
Insight
AI's primary objective is offloading human cognitive burden during peak strain
“I've always felt one of the noble aims of AI, Alex, is to transfer a cognitive burden from the human to the system at a time when the human feels that burden to be most heavy.”
Insight
Specialized, compact AI models match performance while significantly reducing latency
“One of the other benefits of specialization is the models can be made much more compact to deliver the same kind of performance relative to the size of the model, right? Because now they're specialized, which means they can run much faster, which means overall…”
Prediction Not checkable as stated
Closed-source models will continue driving value in broad horizontal enterprise tasks
“There will be areas, for example, like software development, right, where there is so much horizontal aspect to it in terms of how it is practiced across the world. Where I do think these other approaches, like, you know, where what you bring to that is the co…”
Disclosure
Capital One uses multiple open-source AI models but favors US-based providers
“We actually use more than one depending on the application. Again, like I said, we have this benchmarking, so we take a look at these models and I mean, we favor US-based models in, in general but beyond that, we're constantly looking for which model provides …”
Assertion Supported
Capital One operates entirely on public cloud infrastructure
“We're the first company first bank that went all in on the cloud. We're entirely on the public cloud.”
Disclosure
Capital One's Chat Concierge AI is live at nationwide auto dealerships
“Chat Concierge is now available. At many dealerships across the company across the country.”