Yang: Imply's main competitors are legacy data warehouses unsuited for streaming
FJ Yang · Apache Druid & An Introduction to Data Rivers // FJ Yang, Imply (FirstMark's Data Driven NYC) · Jun 12, 2019 · at 20:21
FJ Yang, co-founder and CEO of Imply, discusses the competitive landscape for real-time analytics and Apache Druid during an audience Q&A at Data Driven NYC.
0:00 / 0:24exact quote · 24.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The largest competition we probably see are more traditional data warehouses. We see a lot of people trying to shoehorn in various Use cases into legacy data warehouses where, you know, data houses, one, they're not built for, like, kind of live streaming ingestion, and then two, a lot of their workflows are around generating, kind of, these large static reports versus the more, kind of, dynamic ad hoc exploration”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from FJ Yang
FJ Yang: Data architecture is trending toward real-time streaming over batch files
“Where I believe the world is starting to trend to is toward a new world where data is not just batched in a static file, but data is constantly in motion, a constant flow of information.”
Yang: Apache Druid merges data warehouses, time series, and search systems
“Druid is a combination of a data warehouse merged with a time series database merged with a search system.”
Yang: Apache Druid can condense raw data 100x through roll-up aggregation
“If you have raw data that's, you know, a hundred gigabytes, Druid can sometimes condense it through roll-up to about a gigabyte in size, so a hundred X reduction.”
Yang: Apache Druid was created to handle hundreds of billions of daily events
“It was created because the volume of data we were dealing with was reaching millions of events per second, and hundreds of billions of events per day.”