The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 4 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Insight
Narkhede: Stream processing behaves like microservices, not faster MapReduce jobs
“What we learned is that, ah, stream processing is in fact much more than a faster MapReduce layer. It, in fact, most of the applications that do stream processing look much more like a microservice of an application, and less like a faster version of a batch o…”
Neha Narkhede Jun 16, 2016 ▶ 24:16 A Kafka-Powered Real-Time Streaming Platform // Neha Narkhede, Confluent [FirstMark's Data Driven]
Prediction Not checkable as stated
Mike Olson predicts MapReduce compute cycles in Hadoop clusters will approach zero
“I think the percentage of cycles spent on MapReduce in Hadoop clusters generally is going to asymptotically approach zero. That's not because there will be less MapReduce happening, but because there will be so much of the other stuff happening.”
Mike Olson Dec 18, 2014 ▶ 10:45 Mike Olson, Cloudera // The Cloudera Story (Hosted by FirstMark Capital)
Assertion Supported
Modern laptops are 10 to 100 times faster than MapReduce-era servers
“But you know, nowadays, like, you know, I've got a Mac M two laptop. It's two years old. It's like probably an order of magnitude to two orders of magnitude faster than the server machines were back when, you know, MapReduce came out and people started buildin…”
Jordan Tigani Oct 24, 2024 ▶ 4:02 The Death of Big Data and Why It’s Time To Think Small | Jordan Tigani, CEO, MotherDuck
Disclosure
Goldman's compliance analytics rely on Hadoop and MapReduce batch processing
“So other than search, everything I described is batch processing. We use standard Hadoop. We use MapReduce.”
Mayur Thakur Dec 19, 2017 ▶ 16:48 Surveillance Platform for Banks // Mayur Thakur, Goldman Sachs (FirstMark's Data Driven)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.