Apache Spark
7 statements across 4 episodes · 7 bullish · 0 bearish · 4 people on the record · first statement Jul 28, 2017 by Michael Jordan · said 104 times in 22 episodes since 2017 · across every show →
Mentions by year
brought up most by Sonal Chokshi (36), Matei Zaharia (11), Peter Levine (8), Ali Ghodsi (7), Prat Moghe (5), Ion Stoica (4), Michael Jordan (3), Chandra Krintz (3)
tap a year for its mentions
2025 11 mentions in 3 episodes 4 per episode
2019 86 mentions in 16 episodes 5 per episode
- a16z Podcast | A Conversation With the Inventor of Spark
- a16z Podcast | Making Sense of Big Data, Machine Learning, and Deep Learning
- a16z Podcast | A New Lab Rises
- a16z Podcast | AMPLab, the Power of Open Source, and the Future of Systems Software
- a16z Podcast | Big Data Goes Really Big
- a16z Podcast | Making the Most of the Data That Matters
- a16z Podcast | The Cool Stuff Only Happens at Scale
- a16z Podcast | Containing the Monolith -- From Microservices to DevOps
- 8 more episodes that year, every mention in 2019 →
2017 7 mentions in 3 episodes 2 per episode
Everything said about Apache Spark, oldest first
Jul 28, 2017 positive
Jordan claims Bag of Little Bootstraps vastly outperforms traditional bootstrap
“Here's the new algorithm, you know, again, implement on Spark. It's that little red box there. It took about a couple hundred seconds to get it, And the answer quality is better than the bootstrap after 15,000 seconds.”
Jan 2, 2019 positive
Jan 2, 2019 positive
Zaharia: Databricks includes all engine improvements in open-source Spark
“It's the same Spark that anyone else gets in the open source. All the libraries, all the improvements we put into the engine, you can just download them and run them yourselves. Or if you want you know, you can talk to a vendor that provides support. Support o…”
Jan 2, 2019 positive
Legacy Hadoop tools like Hive, Pig, and Mahout now run on Spark
“So in particular you know, one of the things we saw is many of the projects that were built on top of Hadoop, such as Hive, which is a SQL processing at scale and Pig and Mahout for machine learning are starting to run on top of Spark as well, so that users of…”
Jan 2, 2019 positive
Zaharia: Toyota uses Spark to analyze social media feedback on cars
“One of the coolest ones I saw was a talk from Toyota about how they use Spark to improve, you know, to basically look at social media feedback, what people are writing about their cars, and figure out things like, oh, is there a problem with the brakes on the …”
Jan 2, 2019 positive
Jan 2, 2019 positive
Stoica: Apache Spark was created to prove Mesos's value
“So actually, Mesos was the first project we developed. This is what started the stack. And Mesos was by design to support multiple cluster computing framework. We started with Hadoop. And actually, one of the reasons we designed Spark, it's To show that it's m…”