Insight certainty 4/5 debate potential 3/5

Rogojan: Databricks and Snowflake are fighting for workflows, not contract lock-in

Ben Rogojan (Seattle Data Guy) · Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy · Jan 23, 2025 · at 41:45

Ben Rogojan (Seattle Data Guy), a data engineering consultant, compares modern cloud data warehouse competition with legacy database lock-in contracts like Teradata.

0:00 / 0:20exact quote · 20.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It's really been a white fight for workflows versus a fight for like contracts. Cause in the past it was like, okay, you sign a ten million dollar contract for Teradata. You're kind of stuck with it, right? Like there's no choice now for the next three to five years. Now it's like, well, you could use Snowflake, or you could use Databricks. It's just whichever one convinces you it's better for whatever workflow you're doing.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Ben Rogojan (Seattle Data Guy)

Prediction Not checkable as stated
Rogojan: Apache Iceberg is becoming the de facto open table format standard
“Iceberg as the de facto, like if we're going to use an open, open table format, that's going to be likely the one people will, I assume, pick since everyone's now supporting it, right?”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 39:14 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Prediction Not checkable as stated
Rogojan: SQL will remain essential as LLM raw data-dumping approaches fail
“The next one I said SQL isn't going anywhere, and I kind of said that for more than one reason. One, I feel like someone's going to tell us it's time to revamp data lake v one again, where we'll just dump everything in there and we'll let an LLM figure it out …”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 51:39 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Insight
Ben Rogojan: Data teams bear primary responsibility for bridging business communication gaps
“I think in general, I found that if you're the data team, you're going to probably have to do a little more of the lift just because it's, Maybe a little easier for you to make that leap.”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 27:51 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Prediction Not checkable as stated
Rogojan: Fully replacing data engineers with AI is still years away
“So I think we're a few years away from just like replacing data engineers, which has been the goal for what it feels like a decade or plus now.”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 32:00 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Opinion
Rogojan: Databricks is better suited for machine learning than data warehousing
“I think Databricks makes sense to me still more from an ML standpoint. I know they like the data warehousing side. I know they, that's where they're going to pitch themselves”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 49:14 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Prediction Not checkable as stated
Ben Rogojan: Natural language-to-SQL AI will not take over anytime soon
“I don't think we're going to see that take over anytime soon, unless you have your data in such a well-formatted way that, like, yeah, of course it's easy to do.”
Ben Rogojan (Seattle Data Guy) Jan 23, 2025 ▶ 53:12 Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.