StarZero All shows Try the podcast clipper →

Sep 22, 2014 · 22m · mad

Tobi Knaup, Mesosphere // Data Driven #29 // Sep 2014 (Hosted by FirstMark Capital)

Tobi Knaup · 17m spoken Matt Turck · 51s spoken Aaron Franco · 20s spoken Joe Gallardo · 18s spoken Microphone Runner · 0s spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

At a Data Driven NYC event, Mesosphere Co-Founder and CTO Tobi Knaup presents the Mesosphere stack and Apache Mesos as a data center operating system. He explains how Mesos orchestrates distributed big data workloads, illustrates its real-world impact through an Airbnb case study, and discusses enterprise adoption during an audience Q&A.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Matt holds 4.4% of the talking time here. How this is scored →

Matt as informed peer 0.8 Guest teaching 5.5 Guest disagreement 0.3 Matt pushing back 0.8
05100:0010:0020:000:49–6:22 · Matt as informed peer 0/10 Presenter Background and Professional Experience Tobi gives a solo presentation introducing his background at Airbnb and the core concept of Mesos as a data center operating system. As a uninterrupted presentation monologue without host participation, the host scores are zero.6:22–9:54 · Matt as informed peer 0/10 Mesos Architecture, Scalability, and Supported Frameworks Tobi details the Mesos kernel architecture, REST APIs, scale at Twitter, and native framework support such as Spark and Docker. The segment is a pure technical monologue, requiring host scores to remain zero.9:54–15:15 · Matt as informed peer 0/10 Case Study: Airbnb's Data Infrastructure and Chronos Tobi walks through Airbnb's data infrastructure evolution and how building Chronos on top of Mesos replaced fragile crontabs with 3,000 lines of code without needing network programming. This is an uninterrupted presentation monologue.15:15–22:39 · Matt as informed peer 3/10 Audience Q&A and Concluding Remarks Host Matt Turck and audience members ask questions regarding commercial viability, open-source vs enterprise features, state management, and isolation versus virtualization. Tobi constructively educates the audience on operational mindsets and container mechanics without any combativeness.0:49–6:22 · Guest teaching 5/10 Presenter Background and Professional Experience Tobi gives a solo presentation introducing his background at Airbnb and the core concept of Mesos as a data center operating system. As a uninterrupted presentation monologue without host participation, the host scores are zero.6:22–9:54 · Guest teaching 5/10 Mesos Architecture, Scalability, and Supported Frameworks Tobi details the Mesos kernel architecture, REST APIs, scale at Twitter, and native framework support such as Spark and Docker. The segment is a pure technical monologue, requiring host scores to remain zero.9:54–15:15 · Guest teaching 6/10 Case Study: Airbnb's Data Infrastructure and Chronos Tobi walks through Airbnb's data infrastructure evolution and how building Chronos on top of Mesos replaced fragile crontabs with 3,000 lines of code without needing network programming. This is an uninterrupted presentation monologue.15:15–22:39 · Guest teaching 6/10 Audience Q&A and Concluding Remarks Host Matt Turck and audience members ask questions regarding commercial viability, open-source vs enterprise features, state management, and isolation versus virtualization. Tobi constructively educates the audience on operational mindsets and container mechanics without any combativeness.0:49–6:22 · Guest disagreement 0/10 Presenter Background and Professional Experience Tobi gives a solo presentation introducing his background at Airbnb and the core concept of Mesos as a data center operating system. As a uninterrupted presentation monologue without host participation, the host scores are zero.6:22–9:54 · Guest disagreement 0/10 Mesos Architecture, Scalability, and Supported Frameworks Tobi details the Mesos kernel architecture, REST APIs, scale at Twitter, and native framework support such as Spark and Docker. The segment is a pure technical monologue, requiring host scores to remain zero.9:54–15:15 · Guest disagreement 0/10 Case Study: Airbnb's Data Infrastructure and Chronos Tobi walks through Airbnb's data infrastructure evolution and how building Chronos on top of Mesos replaced fragile crontabs with 3,000 lines of code without needing network programming. This is an uninterrupted presentation monologue.15:15–22:39 · Guest disagreement 1/10 Audience Q&A and Concluding Remarks Host Matt Turck and audience members ask questions regarding commercial viability, open-source vs enterprise features, state management, and isolation versus virtualization. Tobi constructively educates the audience on operational mindsets and container mechanics without any combativeness.0:49–6:22 · Matt pushing back 0/10 Presenter Background and Professional Experience Tobi gives a solo presentation introducing his background at Airbnb and the core concept of Mesos as a data center operating system. As a uninterrupted presentation monologue without host participation, the host scores are zero.6:22–9:54 · Matt pushing back 0/10 Mesos Architecture, Scalability, and Supported Frameworks Tobi details the Mesos kernel architecture, REST APIs, scale at Twitter, and native framework support such as Spark and Docker. The segment is a pure technical monologue, requiring host scores to remain zero.9:54–15:15 · Matt pushing back 0/10 Case Study: Airbnb's Data Infrastructure and Chronos Tobi walks through Airbnb's data infrastructure evolution and how building Chronos on top of Mesos replaced fragile crontabs with 3,000 lines of code without needing network programming. This is an uninterrupted presentation monologue.15:15–22:39 · Matt pushing back 3/10 Audience Q&A and Concluding Remarks Host Matt Turck and audience members ask questions regarding commercial viability, open-source vs enterprise features, state management, and isolation versus virtualization. Tobi constructively educates the audience on operational mindsets and container mechanics without any combativeness.

speaking balance: gold is Matt, purple is the guest (3 minute bins)

0:00 · Matt 11.6% · guest 88.4%0:00 · Matt 11.6% · guest 88.4%3:00 · Matt 0% · guest 100%3:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%12:00 · Matt 0% · guest 100%12:00 · Matt 0% · guest 100%15:00 · Matt 21.1% · guest 78.9%15:00 · Matt 21.1% · guest 78.9%18:00 · Matt 0.1% · guest 99.9%18:00 · Matt 0.1% · guest 99.9%21:00 · Matt 3.8% · guest 96.2%21:00 · Matt 3.8% · guest 96.2%
Sharpest disagreement ▶ 21:00 Differentiating isolation from virtualization

Tobi directly reframes the questioner's premise that virtual machines and containers are equivalent, explaining that hypervisors create unoptimizable black boxes whereas isolation enables ultra-fast five-second job scheduling.

 Hardest push from Matt ▶ 15:20 Challenging market readiness beyond Valley tech companies

Matt Turck pushes past presentation hype by pointing out that Airbnb is an exponential Silicon Valley outlier, questioning whether traditional enterprise markets are actually ready to adopt Mesos.

 Biggest teaching moment ▶ 12:45 Explaining zero-socket distributed systems

Tobi educates the audience on the power of Mesos abstractions by highlighting that Chronos functions as a full distributed system using under 3,000 lines of code without ever opening a network socket directly.

 Matt holds his own ▶ 15:20 Probing enterprise market adoption limits

Matt Turck demonstrates market insight by framing the boundary between hyper-growth tech early adopters and conservative enterprise customers when evaluating Mesos adoption.
the scores for every segment, with the reasoning behind each
ChapterTopicMatt as informed peerGuest teachingGuest disagreementMatt pushing backWhy
Presenter Background and Professional Experience 0500 Tobi gives a solo presentation introducing his background at Airbnb and the core concept of Mesos as a data center operating system. As a uninterrupted presentation monologue without host participation, the host scores are zero.
Mesos Architecture, Scalability, and Supported Frameworks 0500 Tobi details the Mesos kernel architecture, REST APIs, scale at Twitter, and native framework support such as Spark and Docker. The segment is a pure technical monologue, requiring host scores to remain zero.
Case Study: Airbnb's Data Infrastructure and Chronos 0600 Tobi walks through Airbnb's data infrastructure evolution and how building Chronos on top of Mesos replaced fragile crontabs with 3,000 lines of code without needing network programming. This is an uninterrupted presentation monologue.
Audience Q&A and Concluding Remarks 3613 Host Matt Turck and audience members ask questions regarding commercial viability, open-source vs enterprise features, state management, and isolation versus virtualization. Tobi constructively educates the audience on operational mindsets and container mechanics without any combativeness.

Statements from this episode (7)

Assertion Contradicted
Knaup: Apache Mesos automatically bin-packs applications to maximize cluster utilization
“One thing that Mesos does is it, you know, it automatically bin packs your applications onto the infrastructure that you have, so you get the highest utilization out of it.”
Tobi Knaup Sep 22, 2014 ▶ 2:17
Assertion Supported
Knaup: Apache Spark was the first application built on Apache Mesos
“Spark, ah, there's a little known fact, Spark was actually the first, ah, application that was ever built on top of Mesos, and it was sort of the, you know, the demo app for Mesos in the beginning.”
Tobi Knaup Sep 22, 2014 ▶ 5:42
Assertion Supported
Knaup: Apache Mesos scales to tens of thousands of nodes and powers Twitter
“And so today, it scales to tens of thousands of nodes. It actually runs, it's the basis for most of Twitter's production infrastructure today.”
Tobi Knaup Sep 22, 2014 ▶ 8:39
Assertion Supported
Knaup: Mesosphere, Twitter, and Airbnb are major committers to Apache Mesos
“It's a top-level Apache project. And, you know, Mesosphere, Twitter, and Airbnb are major committers on the project.”
Tobi Knaup Sep 22, 2014 ▶ 8:46
Assertion Contradicted
Knaup: Chronos distributed system requires zero network programming due to Mesos
“It's a distributed system and it never opens a single socket. There's no network programming whatsoever in Kronos because Mesos takes care of all of that.”
Tobi Knaup Sep 22, 2014 ▶ 13:58
Assertion Not checkable as stated
Knaup: Airbnb relies on just one person to run data infrastructure
“And what's really great is that they basically have one single person that runs all of this data infrastructure for this huge company.”
Tobi Knaup Sep 22, 2014 ▶ 14:58
Insight
Knaup: Five-second jobs are highly inefficient to run in VMs compared to container isolation
“Launching very, you know, quickly launching very short jobs, like jobs that will only take five seconds to run. You can do that if you're using isolation. It's impossible, or it's not impossible, but it's very inefficient with VMs.”
Tobi Knaup Sep 22, 2014 ▶ 21:40
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more