YARN and Mesos enable modern on-cluster business intelligence
Shant Hovsepian · 10 Commandments for BI in Big Data, Shant Hovsepian, Arcadia Data (Data Driven NYC / FirstMark) · Dec 17, 2015 · at 6:53
Shant Hovsepian, CTO of Arcadia Data, explains how modern infrastructure frameworks allow analytical application development directly on data clusters.
0:00 / 0:07exact quote · 7.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“On cluster BI is something that's possible now. Thanks to things like Yarn, Mesos, we're seeing a whole new resurgence of operating systems.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shant Hovsepian
Business intelligence pricing models that penalize increased user adoption are dangerous
“Pricing models that penalize you for increased adoption are kind of dangerous, right?”
Big data analytics sharing should mirror GitHub's clone and fork model
“When I think of sharing, I think of the GitHub model, right, where it's not, here's your final published product, but here is, clone it, fork it, and this is how I derive at those insights, so other people can learn from those insights, and that's really impor…”
Effective BI tools must analyze big data natively without ETL transformation
“You want to find the BI solution that won't tell you, hey, sorry, please transform your data into a pretty table. You want BI solutions that can really analyze the data in its native form because there is value for having data in that form.”
Extracting and moving big data into separate data marts creates severe overhead
“It's also a huge maintenance problem. So, a lot of customers we talk to don't want to, you know, forget about the network performance or the CPU computation, right? It's just a management overhead of now there are two copies of something as logically the same.”
Reimplementing security across storage, database, and BI layers causes data loss
“If you have to sort of re-implement your whole security model, you know, once in your storage layer, once your database layer, and once in your application BI layer, you're not going to do it, right? You're going to lose information.”
MongoDB security architecture enables enterprise application integration and data lineage
“Mongo has this amazing security architecture now that your applications can plug into, propagate that user information all the way up to the application layer, and enforce, you know, this visualization and the data lineage associated with it along the way.”