Jan 2, 2019 · 26m · a16z

a16z Podcast | Big Data Goes Really Big

Prat Moghe · 10m spoken Peter Levine · 9m spoken Michael Copeland · 4m spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

In this episode of the a16z podcast, host Michael Copeland, Cazena CEO Pratt Mogai, and Andreessen Horowitz General Partner Peter Levine explore the paradigm shift of democratizing big data in the cloud. They discuss how moving from on-premise infrastructure to cloud-native architectures reduces operational costs, fosters agile organizational cultures, and lays the groundwork for future machine intelligence.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. How this is scored →

The host as informed peer 1.7 Guest teaching 3.4 Guest disagreement 0.6 The host pushing back 1.1
05100:0010:0020:002:08–4:23 · The host as informed peer 1/10 Transitioning from Big Data One Point Zero to Two Host Michael Copeland sets up the segment by asking why big data has struggled to move to the cloud. Prat Moghe and Peter Levine explain the technical hurdles of siloed data versus cloud infrastructure and outline the shift from Big Data 1.0 to 2.0.4:23–9:12 · The host as informed peer 2/10 Driving Enterprise Decisions Through Mobile and Cloud Data Host probes whether non-tech companies like shoe sellers actually need big data, prompting Prat to counter with a quick rhetorical question and explain hyper-targeting.9:12–11:25 · The host as informed peer 1/10 Cultural Transformation and Agility via Centralized Data Dashboards Prat highlights the cultural and organizational impact of data democratization, contrasting traditional siloed retailers with an agile e-tailer using Tableau.11:25–16:06 · The host as informed peer 2/10 Leveraging Predictive Analytics in Public Sector and Civic Applications Host pushes the conversation beyond Fortune 1000 enterprises to ask about broader applications. Prat illustrates public sector impact through New York City's predictive policing data.16:06–20:47 · The host as informed peer 2/10 Overcoming Cloud Transfer Friction with Big Data as Service When host asks if winners are emerging among tech stacks, Prat rejects the framing, explaining that choosing a single winner is the wrong approach for workload mapping.20:47–23:22 · The host as informed peer 2/10 The Emergence of Machine Intelligence and Big Data Three Peter projects into Big Data 3.0 machine intelligence, but the host interrupts to ground the timeline, noting that industry is still largely trapped in 1.0.23:22–26:36 · The host as informed peer 2/10 Constructing the Executive Boardroom Pitch for Cloud Migration Host prompts guests with a practical roleplay scenario on convincing a board of directors to migrate to cloud data, drawing out operational pitches from both guests.2:08–4:23 · Guest teaching 3/10 Transitioning from Big Data One Point Zero to Two Host Michael Copeland sets up the segment by asking why big data has struggled to move to the cloud. Prat Moghe and Peter Levine explain the technical hurdles of siloed data versus cloud infrastructure and outline the shift from Big Data 1.0 to 2.0.4:23–9:12 · Guest teaching 3/10 Driving Enterprise Decisions Through Mobile and Cloud Data Host probes whether non-tech companies like shoe sellers actually need big data, prompting Prat to counter with a quick rhetorical question and explain hyper-targeting.9:12–11:25 · Guest teaching 4/10 Cultural Transformation and Agility via Centralized Data Dashboards Prat highlights the cultural and organizational impact of data democratization, contrasting traditional siloed retailers with an agile e-tailer using Tableau.11:25–16:06 · Guest teaching 4/10 Leveraging Predictive Analytics in Public Sector and Civic Applications Host pushes the conversation beyond Fortune 1000 enterprises to ask about broader applications. Prat illustrates public sector impact through New York City's predictive policing data.16:06–20:47 · Guest teaching 5/10 Overcoming Cloud Transfer Friction with Big Data as Service When host asks if winners are emerging among tech stacks, Prat rejects the framing, explaining that choosing a single winner is the wrong approach for workload mapping.20:47–23:22 · Guest teaching 3/10 The Emergence of Machine Intelligence and Big Data Three Peter projects into Big Data 3.0 machine intelligence, but the host interrupts to ground the timeline, noting that industry is still largely trapped in 1.0.23:22–26:36 · Guest teaching 2/10 Constructing the Executive Boardroom Pitch for Cloud Migration Host prompts guests with a practical roleplay scenario on convincing a board of directors to migrate to cloud data, drawing out operational pitches from both guests.2:08–4:23 · Guest disagreement 0/10 Transitioning from Big Data One Point Zero to Two Host Michael Copeland sets up the segment by asking why big data has struggled to move to the cloud. Prat Moghe and Peter Levine explain the technical hurdles of siloed data versus cloud infrastructure and outline the shift from Big Data 1.0 to 2.0.4:23–9:12 · Guest disagreement 1/10 Driving Enterprise Decisions Through Mobile and Cloud Data Host probes whether non-tech companies like shoe sellers actually need big data, prompting Prat to counter with a quick rhetorical question and explain hyper-targeting.9:12–11:25 · Guest disagreement 0/10 Cultural Transformation and Agility via Centralized Data Dashboards Prat highlights the cultural and organizational impact of data democratization, contrasting traditional siloed retailers with an agile e-tailer using Tableau.11:25–16:06 · Guest disagreement 0/10 Leveraging Predictive Analytics in Public Sector and Civic Applications Host pushes the conversation beyond Fortune 1000 enterprises to ask about broader applications. Prat illustrates public sector impact through New York City's predictive policing data.16:06–20:47 · Guest disagreement 2/10 Overcoming Cloud Transfer Friction with Big Data as Service When host asks if winners are emerging among tech stacks, Prat rejects the framing, explaining that choosing a single winner is the wrong approach for workload mapping.20:47–23:22 · Guest disagreement 1/10 The Emergence of Machine Intelligence and Big Data Three Peter projects into Big Data 3.0 machine intelligence, but the host interrupts to ground the timeline, noting that industry is still largely trapped in 1.0.23:22–26:36 · Guest disagreement 0/10 Constructing the Executive Boardroom Pitch for Cloud Migration Host prompts guests with a practical roleplay scenario on convincing a board of directors to migrate to cloud data, drawing out operational pitches from both guests.2:08–4:23 · The host pushing back 0/10 Transitioning from Big Data One Point Zero to Two Host Michael Copeland sets up the segment by asking why big data has struggled to move to the cloud. Prat Moghe and Peter Levine explain the technical hurdles of siloed data versus cloud infrastructure and outline the shift from Big Data 1.0 to 2.0.4:23–9:12 · The host pushing back 3/10 Driving Enterprise Decisions Through Mobile and Cloud Data Host probes whether non-tech companies like shoe sellers actually need big data, prompting Prat to counter with a quick rhetorical question and explain hyper-targeting.9:12–11:25 · The host pushing back 0/10 Cultural Transformation and Agility via Centralized Data Dashboards Prat highlights the cultural and organizational impact of data democratization, contrasting traditional siloed retailers with an agile e-tailer using Tableau.11:25–16:06 · The host pushing back 1/10 Leveraging Predictive Analytics in Public Sector and Civic Applications Host pushes the conversation beyond Fortune 1000 enterprises to ask about broader applications. Prat illustrates public sector impact through New York City's predictive policing data.16:06–20:47 · The host pushing back 2/10 Overcoming Cloud Transfer Friction with Big Data as Service When host asks if winners are emerging among tech stacks, Prat rejects the framing, explaining that choosing a single winner is the wrong approach for workload mapping.20:47–23:22 · The host pushing back 2/10 The Emergence of Machine Intelligence and Big Data Three Peter projects into Big Data 3.0 machine intelligence, but the host interrupts to ground the timeline, noting that industry is still largely trapped in 1.0.23:22–26:36 · The host pushing back 0/10 Constructing the Executive Boardroom Pitch for Cloud Migration Host prompts guests with a practical roleplay scenario on convincing a board of directors to migrate to cloud data, drawing out operational pitches from both guests.

speaking balance: gold is the host, purple is the guest (3 minute bins)

0:00 · the host 0% · guest 100%0:00 · the host 0% · guest 100%3:00 · the host 0% · guest 100%3:00 · the host 0% · guest 100%6:00 · the host 0% · guest 100%6:00 · the host 0% · guest 100%9:00 · the host 0% · guest 100%9:00 · the host 0% · guest 100%12:00 · the host 0% · guest 100%12:00 · the host 0% · guest 100%15:00 · the host 0% · guest 100%15:00 · the host 0% · guest 100%18:00 · the host 0% · guest 100%18:00 · the host 0% · guest 100%21:00 · the host 0% · guest 100%21:00 · the host 0% · guest 100%24:00 · the host 0% · guest 100%24:00 · the host 0% · guest 100%
Sharpest disagreement ▶ 19:06 Rejecting Stack Winner Framing

Prat explicitly dismisses the host's premise about emerging stack winners, declaring it the wrong question to ask when solving enterprise workloads.

Hardest push from the host ▶ 6:15 Challenging Relevancy for Basic Businesses

Host Michael Copeland pushes back against general claims that every company is data-driven, asking why a standard retail shoe seller should care about big data.

Biggest teaching moment ▶ 19:06 Workloads Over Silver-Bullet Tech Stacks

Prat reframes the entire tech stack discussion, educating the host that workload performance rather than picking a specific technology vendor dictates success.

The host holds their own ▶ 22:54 Grounding the 3.0 Timeline

Host Michael Copeland demonstrates domain realism by pointing out that the market is jumping ahead to 3.0 while most real-world enterprises remain stuck in 1.0.

the scores for every segment, with the reasoning behind each
ChapterTopicThe host as informed peerGuest teachingGuest disagreementThe host pushing backWhy
Transitioning from Big Data One Point Zero to Two 1300 Host Michael Copeland sets up the segment by asking why big data has struggled to move to the cloud. Prat Moghe and Peter Levine explain the technical hurdles of siloed data versus cloud infrastructure and outline the shift from Big Data 1.0 to 2.0.
Driving Enterprise Decisions Through Mobile and Cloud Data 2313 Host probes whether non-tech companies like shoe sellers actually need big data, prompting Prat to counter with a quick rhetorical question and explain hyper-targeting.
Cultural Transformation and Agility via Centralized Data Dashboards 1400 Prat highlights the cultural and organizational impact of data democratization, contrasting traditional siloed retailers with an agile e-tailer using Tableau.
Leveraging Predictive Analytics in Public Sector and Civic Applications 2401 Host pushes the conversation beyond Fortune 1000 enterprises to ask about broader applications. Prat illustrates public sector impact through New York City's predictive policing data.
Overcoming Cloud Transfer Friction with Big Data as Service 2522 When host asks if winners are emerging among tech stacks, Prat rejects the framing, explaining that choosing a single winner is the wrong approach for workload mapping.
The Emergence of Machine Intelligence and Big Data Three 2312 Peter projects into Big Data 3.0 machine intelligence, but the host interrupts to ground the timeline, noting that industry is still largely trapped in 1.0.
Constructing the Executive Boardroom Pitch for Cloud Migration 2200 Host prompts guests with a practical roleplay scenario on convincing a board of directors to migrate to cloud data, drawing out operational pitches from both guests.

Statements from this episode (10)

Assertion Contradicted
Mogai: NYC reduced gunfire and police deployment using predictive data
“You know, like in New York City, I think this was New Year's Eve, and they collected statistics on random gunfire, and they used that data to predict where they should deploy, ah, police so that they could ensure safety, right? And what they realized is that t…”
Prat Moghe Jan 2, 2019 ▶ 0:55
Insight
Levine: Cloud tech expands big data access beyond Fortune 2000
“This not only democratizes the use of big data, it democratizes the organizations that use big data, such that it's not limited to the, only the Fortune 2000 who have the capabilities to set up these large data centers.”
Peter Levine Jan 2, 2019 ▶ 1:44
Insight
Pratt Mogai: Big data is difficult to migrate due to deep enterprise integration
“If you look at big data is not a siloed application. It gets infused through the organization. So it's usually part of some operational business process. And it's really hard to lift and shift it into the cloud.”
Prat Moghe Jan 2, 2019 ▶ 2:45
Assertion Not checkable as stated
Peter Levine: Big Data 2.0 is shifting workloads from on-prem to cloud
“And now what we're seeing is just like we saw applications move from on-prem to a SaaS offering, we are thankfully seeing Big Data enters A big data two dot O era, which is moving big data from on-prem into the cloud.”
Peter Levine Jan 2, 2019 ▶ 3:50
Assertion Supported
Pratt Mogai: Big Data 1.0 is a $10B market dominated by incumbents
“One dot O, which is where most of the world is, it's a ten billion dollar market, largely going to a few incumbents, right?”
Prat Moghe Jan 2, 2019 ▶ 4:42
Opinion
Pratt Mogai: Mass direct marketing is over
“The days of, you know, mass direct marketing are over.”
Prat Moghe Jan 2, 2019 ▶ 6:39
Prediction Not checkable as stated
Moghe: Democratized cloud big data will flatten corporate organizational structures
“I think that's the Google-like or the Facebook-like culture you want to see permeated across all the top 2000 enterprises, and it's not there today. So I think the long-term implication of big data, cloud making it really democratic is access to everyone, flat…”
Prat Moghe Jan 2, 2019 ▶ 10:59
Assertion Not checkable as stated
Levine: On-premise data centers give large companies an advantage over SMBs
“Large organizations who have the expertise and budgets to go create on-prem data centers have a huge competitive advantage over the hundreds of thousands of small to mid-sized companies that are probably using Excel spreadsheets as their data analytics tool ri…”
Peter Levine Jan 2, 2019 ▶ 16:06
Prediction Not checkable as stated
Levine: Application-aware big data will drive the next software wave
“I believe that Application aware big data is sort of the next driver in this space, and we'll get, we will get an application layer that will become very intelligent as a result of this underlying big data.”
Peter Levine Jan 2, 2019 ▶ 22:13
Assertion Not checkable as stated
Levine: Big data performance issues only occur in hybrid cloud setups
“And like Pratt said before, the performance issue is only an issue when we're going back and forth from the cloud to on prem.”
Peter Levine Jan 2, 2019 ▶ 25:39
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.