StarZero All shows Try the podcast clipper →

Nov 9, 2016 · 22m · mad

Making Big Data Accessible Using the Cloud // Ashish Thusoo, Qubole [FirstMark's Data Driven]

Ashish Thusoo · 19m spoken Matt Turck · 34s spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

In this Data Driven NYC keynote presentation and Q&A, Qubole CEO and co-founder Ashish Thusoo explains how turnkey cloud infrastructure and self-service platforms overcome traditional enterprise bottlenecks to make big data accessible and actionable across all corporate departments.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Matt holds 2.6% of the talking time here. How this is scored →

Matt as informed peer 0.6 Guest teaching 4.9 Guest disagreement 0.3 Matt pushing back 0.6
05100:0010:0020:000:37–3:40 · Matt as informed peer 0/10 Evolution of Data: Transactional vs. Interaction Data In this solo presentation segment, the host does not speak, requiring all host-side scores to be zero. Ashish provides an educational primer on the shift from transactional data in the 1990s to modern interaction data.3:40–6:42 · Matt as informed peer 0/10 Big Data as a Core Competitive Advantage The monologue presentation continues without host participation. Ashish explains how big data technologies evolved into a core competitive requirement and references his experience building infrastructure at Facebook.6:42–9:48 · Matt as informed peer 0/10 Realities and Bottlenecks in Enterprise Big Data Ashish presents the structural bottlenecks in enterprise data back offices without host involvement. He details how central data teams inadvertently become bottlenecks due to inflexible infrastructure.9:48–12:02 · Matt as informed peer 0/10 Automated Orchestration and Auto-Scaling in the Cloud This monologue segment covers cloud auto-scaling, APIs for compute and storage, and Qubole's operational capabilities. The host remains silent throughout.12:02–14:42 · Matt as informed peer 0/10 Empowering Users through Self-Service Access The guest discusses self-service workbenches, cloud security, compliance, and geographic availability. The segment is a monologue so host scores remain at zero.14:42–18:03 · Matt as informed peer 4/10 Qubole Case Study, Summary, and Conclusion Host Matt Turck joins the conversation at 15:50 and pushes past the high-level pitch by pointing out that many Fortune 1000 enterprise executives still insist their data will never go to the cloud. Ashish responds constructively by detailing shifts in enterprise adoption and security roadmaps.18:03–20:08 · Matt as informed peer 0/10 Q&A: Vendor Lock-In and Cloud Competition An audience member asks about vendor lock-in and pricing concerns, and Ashish answers by explaining multi-cloud availability and open ecosystems. The host does not actively engage or push back during this Q&A.0:37–3:40 · Guest teaching 5/10 Evolution of Data: Transactional vs. Interaction Data In this solo presentation segment, the host does not speak, requiring all host-side scores to be zero. Ashish provides an educational primer on the shift from transactional data in the 1990s to modern interaction data.3:40–6:42 · Guest teaching 5/10 Big Data as a Core Competitive Advantage The monologue presentation continues without host participation. Ashish explains how big data technologies evolved into a core competitive requirement and references his experience building infrastructure at Facebook.6:42–9:48 · Guest teaching 5/10 Realities and Bottlenecks in Enterprise Big Data Ashish presents the structural bottlenecks in enterprise data back offices without host involvement. He details how central data teams inadvertently become bottlenecks due to inflexible infrastructure.9:48–12:02 · Guest teaching 5/10 Automated Orchestration and Auto-Scaling in the Cloud This monologue segment covers cloud auto-scaling, APIs for compute and storage, and Qubole's operational capabilities. The host remains silent throughout.12:02–14:42 · Guest teaching 5/10 Empowering Users through Self-Service Access The guest discusses self-service workbenches, cloud security, compliance, and geographic availability. The segment is a monologue so host scores remain at zero.14:42–18:03 · Guest teaching 5/10 Qubole Case Study, Summary, and Conclusion Host Matt Turck joins the conversation at 15:50 and pushes past the high-level pitch by pointing out that many Fortune 1000 enterprise executives still insist their data will never go to the cloud. Ashish responds constructively by detailing shifts in enterprise adoption and security roadmaps.18:03–20:08 · Guest teaching 4/10 Q&A: Vendor Lock-In and Cloud Competition An audience member asks about vendor lock-in and pricing concerns, and Ashish answers by explaining multi-cloud availability and open ecosystems. The host does not actively engage or push back during this Q&A.0:37–3:40 · Guest disagreement 0/10 Evolution of Data: Transactional vs. Interaction Data In this solo presentation segment, the host does not speak, requiring all host-side scores to be zero. Ashish provides an educational primer on the shift from transactional data in the 1990s to modern interaction data.3:40–6:42 · Guest disagreement 0/10 Big Data as a Core Competitive Advantage The monologue presentation continues without host participation. Ashish explains how big data technologies evolved into a core competitive requirement and references his experience building infrastructure at Facebook.6:42–9:48 · Guest disagreement 0/10 Realities and Bottlenecks in Enterprise Big Data Ashish presents the structural bottlenecks in enterprise data back offices without host involvement. He details how central data teams inadvertently become bottlenecks due to inflexible infrastructure.9:48–12:02 · Guest disagreement 0/10 Automated Orchestration and Auto-Scaling in the Cloud This monologue segment covers cloud auto-scaling, APIs for compute and storage, and Qubole's operational capabilities. The host remains silent throughout.12:02–14:42 · Guest disagreement 0/10 Empowering Users through Self-Service Access The guest discusses self-service workbenches, cloud security, compliance, and geographic availability. The segment is a monologue so host scores remain at zero.14:42–18:03 · Guest disagreement 1/10 Qubole Case Study, Summary, and Conclusion Host Matt Turck joins the conversation at 15:50 and pushes past the high-level pitch by pointing out that many Fortune 1000 enterprise executives still insist their data will never go to the cloud. Ashish responds constructively by detailing shifts in enterprise adoption and security roadmaps.18:03–20:08 · Guest disagreement 1/10 Q&A: Vendor Lock-In and Cloud Competition An audience member asks about vendor lock-in and pricing concerns, and Ashish answers by explaining multi-cloud availability and open ecosystems. The host does not actively engage or push back during this Q&A.0:37–3:40 · Matt pushing back 0/10 Evolution of Data: Transactional vs. Interaction Data In this solo presentation segment, the host does not speak, requiring all host-side scores to be zero. Ashish provides an educational primer on the shift from transactional data in the 1990s to modern interaction data.3:40–6:42 · Matt pushing back 0/10 Big Data as a Core Competitive Advantage The monologue presentation continues without host participation. Ashish explains how big data technologies evolved into a core competitive requirement and references his experience building infrastructure at Facebook.6:42–9:48 · Matt pushing back 0/10 Realities and Bottlenecks in Enterprise Big Data Ashish presents the structural bottlenecks in enterprise data back offices without host involvement. He details how central data teams inadvertently become bottlenecks due to inflexible infrastructure.9:48–12:02 · Matt pushing back 0/10 Automated Orchestration and Auto-Scaling in the Cloud This monologue segment covers cloud auto-scaling, APIs for compute and storage, and Qubole's operational capabilities. The host remains silent throughout.12:02–14:42 · Matt pushing back 0/10 Empowering Users through Self-Service Access The guest discusses self-service workbenches, cloud security, compliance, and geographic availability. The segment is a monologue so host scores remain at zero.14:42–18:03 · Matt pushing back 4/10 Qubole Case Study, Summary, and Conclusion Host Matt Turck joins the conversation at 15:50 and pushes past the high-level pitch by pointing out that many Fortune 1000 enterprise executives still insist their data will never go to the cloud. Ashish responds constructively by detailing shifts in enterprise adoption and security roadmaps.18:03–20:08 · Matt pushing back 0/10 Q&A: Vendor Lock-In and Cloud Competition An audience member asks about vendor lock-in and pricing concerns, and Ashish answers by explaining multi-cloud availability and open ecosystems. The host does not actively engage or push back during this Q&A.

speaking balance: gold is Matt, purple is the guest (3 minute bins)

0:00 · Matt 0% · guest 100%0:00 · Matt 0% · guest 100%3:00 · Matt 0% · guest 100%3:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%12:00 · Matt 0% · guest 100%12:00 · Matt 0% · guest 100%15:00 · Matt 19.2% · guest 80.8%15:00 · Matt 19.2% · guest 80.8%18:00 · Matt 0.2% · guest 99.8%18:00 · Matt 0.2% · guest 99.8%21:00 · Matt 1.9% · guest 98.1%21:00 · Matt 1.9% · guest 98.1%
Sharpest disagreement ▶ 18:01 Addressing vendor lock-in skepticism

In a very collaborative session, Ashish gently counters vendor lock-in fears by pointing out that cloud competition from Azure and Google keeps pricing honest and drives cloud-agnostic platform adoption.

 Hardest push from Matt ▶ 16:06 Pitch versus enterprise reality challenge

Host Matt Turck challenges the optimistic cloud migration narrative by highlighting that Fortune 1000 companies routinely insist their data will never leave on-premise infrastructure.

 Biggest teaching moment ▶ 7:20 Exposing the enterprise data bottleneck

Ashish educates the audience on why traditional enterprise data architectures break down when companies place a central data team as a gatekeeper in front of static infrastructure.

 Matt holds his own ▶ 15:50 Interjecting with Fortune 1000 pushback

Host Matt Turck demonstrates domain knowledge of enterprise sales obstacles by interrupting the presentation flow to ask where the industry actually stands regarding Fortune 1000 cloud reluctance.
the scores for every segment, with the reasoning behind each
ChapterTopicMatt as informed peerGuest teachingGuest disagreementMatt pushing backWhy
Evolution of Data: Transactional vs. Interaction Data 0500 In this solo presentation segment, the host does not speak, requiring all host-side scores to be zero. Ashish provides an educational primer on the shift from transactional data in the 1990s to modern interaction data.
Big Data as a Core Competitive Advantage 0500 The monologue presentation continues without host participation. Ashish explains how big data technologies evolved into a core competitive requirement and references his experience building infrastructure at Facebook.
Realities and Bottlenecks in Enterprise Big Data 0500 Ashish presents the structural bottlenecks in enterprise data back offices without host involvement. He details how central data teams inadvertently become bottlenecks due to inflexible infrastructure.
Automated Orchestration and Auto-Scaling in the Cloud 0500 This monologue segment covers cloud auto-scaling, APIs for compute and storage, and Qubole's operational capabilities. The host remains silent throughout.
Empowering Users through Self-Service Access 0500 The guest discusses self-service workbenches, cloud security, compliance, and geographic availability. The segment is a monologue so host scores remain at zero.
Qubole Case Study, Summary, and Conclusion 4514 Host Matt Turck joins the conversation at 15:50 and pushes past the high-level pitch by pointing out that many Fortune 1000 enterprise executives still insist their data will never go to the cloud. Ashish responds constructively by detailing shifts in enterprise adoption and security roadmaps.
Q&A: Vendor Lock-In and Cloud Competition 0410 An audience member asks about vendor lock-in and pricing concerns, and Ashish answers by explaining multi-cloud availability and open ecosystems. The host does not actively engage or push back during this Q&A.

Statements from this episode (9)

Disclosure
Ashish Thusoo led Facebook's data infrastructure team before founding Qubole
“Before I started QBOL, I was at Facebook, and I built out, I ran the team that built out the infrastructure there.”
Ashish Thusoo Nov 9, 2016 ▶ 5:08
Insight
Thusoo: Centralized enterprise data teams usually become operational bottlenecks
“More often than not, this, ah, data team eventually becomes a bottleneck, ah, and, ah, you know, it sort of delays, ah, delays the, ah, availability of data and what people can do with that data.”
Ashish Thusoo Nov 9, 2016 ▶ 7:17
Assertion Not checkable as stated
Thusoo: On-premise big data deployments take 6 to 18 months
“If you are, you know, going with a traditional approach of, you know, standing this up in your data centers, you know, ah, I think some of the estimates are it takes between six to 18 months to get to production.”
Ashish Thusoo Nov 9, 2016 ▶ 9:27
Assertion Not checkable as stated
Thusoo: Qubole clusters regularly auto-scale 36x for average customers
“QBOL, for example, in QBOL, you know, we regularly have, ah, you know, with our autoscaling algorithms, we are, we regularly scale up clusters to 36 times the size of the minimum clusters on an average customer”
Ashish Thusoo Nov 9, 2016 ▶ 11:07
Assertion Not checkable as stated
Qubole processes around 500 petabytes of data monthly
“You know, for example, we process around 500 petabytes of data every month across workloads ranging from you know, mundane ETL workloads to more complex machine learning workloads to ad hoc analysis and so on and so forth.”
Ashish Thusoo Nov 9, 2016 ▶ 15:10
Assertion Supported
Capital One publicly announced plans to close data centers at AWS re:Invent
“I think last year in reInvent, right, Capital One was up in the state saying that, you know, I'm going to, we're going to shut down our data centers, move things to the cloud.”
Ashish Thusoo Nov 9, 2016 ▶ 17:38
Assertion Supported
Thusoo: Cloud infrastructure pricing decreased between 2012 and 2016
“Actually the cloud pricing has gone down over the last three, four years.”
Ashish Thusoo Nov 9, 2016 ▶ 18:43
Assertion Not checkable as stated
Thusoo: Multi-cloud enterprise adoption remains rare in 2016
“We haven't seen, we have started to see in the press mentions of a company using two clouds and stuff like that, but it's not very wholesale right now.”
Ashish Thusoo Nov 9, 2016 ▶ 19:11
Prediction Not checkable as stated
Thusoo: Cloud vendor lock-in concerns will diminish as cloud-agnostic software grows
“I think some of those vendor lock-in issues, they'll start to go away.”
Ashish Thusoo Nov 9, 2016 ▶ 19:39
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more