Keydunov: Production AI data apps require extensive Python scaffolding around models
Artem Keydunov · Powering your Copilot for Data - with Artem Keydunov from Cube.dev · Oct 27, 2023 · at 33:54
Artem Keydunov discusses engineering requirements for building functional data copilots beyond toy demonstrations.
0:00 / 0:24exact quote · 24.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“When we're talking about production level use cases, it's quite a lot of Python code around, you know, like, your model to make it work, to be honest. It's, like, It's not that magic that you just throw the model in it, like it can give you all this answers. For like a toy use case is the one we have on a, you know, like our demo page or something. It works fine. It's great. But you know, like if you want to do like a lot of post-processing, do a mass on URL, you probably need to code it in Python anyway.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Artem Keydunov
Keydunov: Natural language AI will not consolidate the fragmented BI market
“I don't think it's going to be something that will change the BI market, you know, like something that will can take The BI market and make it more consolidated rather than, you know, like what we have right now. I think it's still re will remain fragmented.”
Keydunov: Modern data stack will not be dramatically disrupted by AI
“I don't see a lot of being compacted by AI specifically. I think, you know, that space is being compacted as much as any other space in terms of, yes, we'll have all this copilot capabilities, some of AI capabilities here and there, but I don't see anything so…”
Keydunov: AI will not make embedded analytics easier to monetize
“I don't think AI really going to change that just because it's using model, you just pay to open AI and that's it. Like everyone can do that, right? It's not much of a Competitive advantage. So it's going to be more like a commodity features that a lot of like…”
Keydunov: The semantic layer is the ideal repository for AI data context
“So our take of that and my take is that semantic layer is just really good place for this context to live because you need to give this context to the humans. You need to give that context to the AI system anyway, right? So that's why you define metric once an…”
Keydunov: Querying a semantic layer over raw SQL reduces LLM errors
“Now, the query, I believe, should be created against semantic layer, because it reduces the room for the error, because what usually happens is that your query to semantic layer would be very simple. It would be like, give me that metric grouped by that dimens…”
Keydunov: Semantic layer metrics should be managed as code via pull requests
“So I think we should treat our metrics and we are in semantic layer as a code, right? And then collaboration is a big part of it. You know, like if there are like a multiple teams that sort of have a different opinions, let them collaborate on the pull request…”