Mar 13, 2024 · 1h 22m · news
Chandra Narayanan: Top 5 Lessons from Leading Analytics at Facebook | E1126 · 20VC with Harry Stebbings
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this deep-dive interview, tech executive and investor Chandra Narayanan shares high-leverage frameworks for growth, analytical mastery, and talent density based on his leadership experiences at PayPal, Facebook, and Sequoia Capital.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Harry holds 16% of the talking time here. How this is scored →
Harry as informed peer 2.3 Guest teaching 4.0 Guest disagreement 1.4 Harry pushing back 2.7
speaking balance: gold is Harry, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 50:50 Narayanan rejects Wall Street compensation model
Narayanan firmly pushes back against Stebbings' Goldman Sachs comparison, arguing that fear-driven retention fails to extract peak human performance over long horizons.
Hardest push from Harry ▶ 50:30 Stebbings challenges guest with Wall Street banking counterexampleStebbings directly refuses Narayanan's four-part retention thesis, citing investment bankers who dislike their work and bosses but stay for multi-hundred-percent bonuses.
Biggest teaching moment ▶ 55:19 Narayanan re-educates Stebbings on data indexing via MongoDB case studyNarayanan corrects Stebbings' misconception that indexing anchors to average performance, demonstrating how benchmarking against comparable peers uncovered a payment gap in Germany.
Harry holds his own ▶ 27:59 Stebbings uses Annie Duke's decision theory to challenge hypothesis validityStebbings demonstrates deep familiarity with decision theory by citing Thinking in Bets to question whether outcome bias invalidates Narayanan's reliance on hypothesis testing.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Harry as informed peer | Guest teaching | Guest disagreement | Harry pushing back | Why |
|---|---|---|---|---|---|---|
| Character Building and the Face of Hard Choices | 2 | 3 | 2 | 3 | Stebbings questions whether spending 6 to 9 months fixing a broken situation is worth the opportunity cost. Narayanan reframes the experience as a character-building exercise essential for handling high-pressure situations later at Facebook. | |
| Defining Impact vs. Motion in Organizational Progress | 1 | 3 | 1 | 1 | Stebbings asks probing questions to define impact versus motion. Narayanan outlines a three-part framework for measuring impact: moving metrics, influencing product decisions, and changing processes. | |
| Activity, The Growth Curve, and Sequoia Capital's Data Strategy | 3 | 4 | 2 | 4 | Stebbings pushes back by asking whether raw activity inherently yields directional data leading to progress. Narayanan educates him using an asymptotic growth curve model and quotes Mark Zuckerberg on operating outside one's comfort zone. | |
| Data-Driven Decision Making and Saying 'No' at Sequoia | 3 | 4 | 2 | 4 | Stebbings challenges Sequoia's focus on saying 'no' quickly, arguing that venture success stems from seeing beauty where others do not. Narayanan explains how filtering bad deals protects investor time and capital allocation. | |
| What Makes Sequoia Exceptional and its Prepared Minds Culture | 1 | 4 | 1 | 2 | Stebbings redirects the discussion to practical implementation, asking how a founder calculates impact per capita. Narayanan details Sequoia's prepared mind culture and breaks down Facebook's per-engineer market cap math. | |
| Defining Growth and Aligning North Star Metrics | 3 | 4 | 2 | 4 | Stebbings challenges using connected users or MAU as a North Star metric, noting it is an output metric rather than an actionable input. Narayanan explains how Facebook separated active user goals from advertiser growth inputs. | |
| The Role of Hypotheses and the Fallacy of Playbooks | 2 | 3 | 1 | 2 | Stebbings asks about shifting North Stars and the relevance of playbooks in changing macro environments. Narayanan emphasizes hypothesis formation to counteract intuition bias. | |
| Validating Hypotheses: PayPal and Facebook Case Studies | 4 | 4 | 1 | 3 | Stebbings demonstrates domain knowledge by citing Annie Duke's Thinking in Bets to question if process-outcome mismatches invalidate hypotheses. Narayanan explains the iterative loop between hypothesis, data validation, and user research. | |
| Timing the First Growth Hire and Reaching Product-Market Fit | 2 | 4 | 1 | 2 | Stebbings shares a founder's colloquial definition of product-market fit before asking Narayanan for his definition. Narayanan lays out a distinct four-stage framework: PMF, scaling PMF, unit economics, and scaling unit economics. | |
| Centralized Standalone Teams vs. Integrated Growth Org | 3 | 4 | 2 | 5 | Stebbings pushes back on the recommendation for early standalone growth teams, pointing out that Series A startups lack the budget for centralized overhead. Narayanan explains that early narrow surface area allows a small team to handle multiple focus areas sequentially. | |
| Hiring for Present Needs and the Journey of Facebook Analytics | 2 | 4 | 1 | 2 | Stebbings questions the common wisdom of hiring 18 months ahead of company stage. Narayanan maps out the four-stage historical evolution of Facebook Analytics to show why hiring for future influence prematurely fails. | |
| The Art of Influence, Storytelling, and Adapting to Leaders | 2 | 5 | 1 | 2 | Stebbings inquires about internal pushback Narayanan faced at Facebook. Narayanan categorizes key executives into data-driven versus story-driven archetypes and details four distinct founder profiles encountered at Sequoia. | |
| Communication Pitfalls and the 'Body of Skills' Hiring Model | 4 | 4 | 3 | 6 | Stebbings directly challenges Narayanan's framework for why people stay at jobs, citing Wall Street investment banks as proof that people endure bad cultures for compensation. Narayanan holds his ground, arguing fear-based retention fails to produce peak performance. | |
| Mastering Analytics: Indexing, the 'So What?' Question, and Simplicity | 3 | 5 | 2 | 4 | Stebbings questions whether data indexing simply anchors metrics to the average, contrasting it with top-decile VC goals. Narayanan clarifies that indexing means benchmarking against logical peer groups, using MongoDB's German payment conversion rates as proof. | |
| Interviewing for Simplicity and Compounding Potential (Slope vs. Asymptote) | 2 | 4 | 1 | 1 | Stebbings asks how to test candidate simplicity during interviews. Narayanan introduces his slope versus asymptote model, prioritizing compounding growth potential over existing credentials. | |
| Career Self-Disruption, Frameworks, and Startup Realities | 2 | 4 | 1 | 1 | Stebbings asks about transitioning from Facebook's massive data volume to early-stage data scarcity. Narayanan demonstrates how complex large-data challenges can be abstracted into small-data business formulas. | |
| Diagnosing Employee Underperformance: Skill, Knowledge, and Value Gaps | 3 | 5 | 2 | 4 | Stebbings cites HubSpot co-founder Brian Halligan's view that PIPs never work and underperformers should be fired immediately. Narayanan explains PIPs fail because managers implement them months too late after abandoning hope. | |
| Why Traditional Hiring Processes Fail to Detect Gaps | 3 | 5 | 1 | 4 | Stebbings argues that skill and knowledge gaps reflect hiring process failure rather than employee fault. Narayanan acknowledges interview limitations and outlines three distinct executive profiles needed at different business stages. | |
| Quick Fire: The Pitfalls of Growth and Analytics Hiring | 1 | 3 | 1 | 1 | Stebbings kicks off a quick-fire round on hiring mistakes and personal composure. Narayanan shares how learning self-hypnosis to overcome a childhood stutter evolved into a daily meditation habit. | |
| Quick Fire: The Customer Satisfaction Challenge | 1 | 4 | 1 | 1 | Stebbings asks about founder challenges and growth mindset shifts. Narayanan explains the critical necessity of paired counter-metrics using PayPal's revenue and fraud teams. | |
| Quick Fire: Mark Zuckerberg's Ability to Scale Strategy | 1 | 3 | 0 | 0 | Stebbings asks for key takeaways from working alongside Mark Zuckerberg. Narayanan describes Zuckerberg's ability to seamlessly connect high-level strategy down to team roadmap initiatives. |
Statements from this episode (41)
Narayanan: Staying Through Difficult Work Situations Builds Character
“The fact is that you need to build you not quitting is a character building exercise.”
Narayanan: Spend 6-9 Months Fixing Broken Work Situations Before Quitting
“So I think two years would have been a very long time, but I think six to nine months, I think it is worthwhile because otherwise I might never have done it.”
Narayanan Almost Got Fired at Facebook for Presenting Uncomfortable Data
“And it ended up being that the senior leadership that did not like what I was saying and I almost got fired for it. And, but that's when I think people like Harvey and Alex at Facebook actually backed me up.”
Zuckerberg Spent 80% of His Time at Facebook Outside Comfort Zone
“Mark once said in a Q and A in internal to Facebook that he said that he, and a lot of the reasons why we do that is because of how secure we are as people. And he would basically say that Something like, I don't know what exact number, but he said like, 80% o…”
Sequoia's Data Team Stopped the Firm From Making Bad Investments
“Many of this, by the way, that, that we stopped Sequoia from investing where I think they would have otherwise invested. It was so close to investment.”
Narayanan: Avoiding bad investments is venture capital's biggest opportunity
“I actually think that good investments are relatively, I mean, there may be this one great investment that nobody knows about, and those are hard, and I agree with that. But if you think about the good investment, very quickly, everyone knows about it. It's no…”
Sequoia Circulates Investment Memos Friday for Monday Partner Meetings
“If you have a Monday morning meeting, they circulate the entire memo on a Friday. And when people go into that room and make a collective decision, They go with a prepared mind, which basically means you better have read your memo. You come in knowing everythi…”
Facebook's Early Growth Marketing Team Operated With Only 6 to 8 People
“And it was like a seven people team or a six people team. And I would think like, how can six or seven or eight people have such enormous output?”
Narayanan: Do not hire engineers without high-impact work assigned to them
“So every new engineer that comes in and will have to contribute so much. Otherwise, if you can't find something that they can do that can be of that type of impact, don't hire.”
Fast Hiring Dilutes Talent Density From A-Plus to A Players
“One thing, if you add more people, what happened is you, the A plus players becomes A and so on. And very fast, you need to get to grow very slowly so you can reach equilibriums very slowly and then keep The value of the entire team high. So do not hire very f…”
Narayanan: Growth is scaling product-market fit via a North Star metric
“I just think of growth is is basically about Identifying methods, approaches that scale product market fit in a scalable way. The way you do that is by identifying a north star metric and moving that metric.”
Narayanan: Facebook chose MAU as North Star to match its mission
“For example, at Facebook at that time that we were there, it was like making the world open and connected. So naturally was you wanted to get everyone in the world on it. So it just naturally meant that you wanted to get the largest number of people to use a p…”
Facebook's Advertiser Growth Team Targeted Headcount Over Direct Revenue
“For example, I'll take the example of Advertiser Growth. In Advertiser Growth that Facebook in the advertisers, we decided not to move The revenue metric, but decided to move the advertiser growth metric, because that's a metric that we actually could tangibly…”
Instagram Acquisition Forced Facebook to Switch Metrics From MAU to DAU
“When Instagram came along to Facebook, we still had the MEU as our goal. And so when we had the MEU as a goal, I mean basically Kevin's system was like, what? We are now in the mobile world. People use the phones all the time. We should be doing we do DAUs. We…”
Narayanan: Indecision costs more than wrong decisions if iteration speed is fast
“I actually think that the cost of not making the decision, in my opinion, is far worse than making a wrong one as long as you can iterate fast.”
Narayanan: Quantitative data alone cannot validate most product hypotheses
“You can't do it through just data. You need to do it through essentially user experience research.”
Severe Winter Weather Directly Increases US Facebook Time Spent
“We found that there's certain parts of America which had an increase in time spent, and we didn't know what happened. And we kept looking and said, what is all this? And we kept digging deep, and it ended up being winter. Very cold winters. People stay in at h…”
Narayanan: Startups should not hire growth leads before product-market fit
“You don't want to hire anyone before product market fit, because at the end of it, I think, as I mentioned to you, I think growth is about scaling the product market fit in a sustainable way. It basically means that if you're not able to grow, if you, if you'r…”
Narayanan: Product-market fit, unit economics, and scaling are four separate steps
“I mean, product market fit, scaling product market fit, unit economics, scaling unit economics. I think those are all four different steps in my opinion. So I actually think that it is, ah, you can get to product market fit, but you may not be able to scale it…”
Narayanan: Startup's first growth hire must be a senior team-builder
“If you had to hire only one person, it'd probably be someone who's relatively senior who can hire everyone else. Or be part of the team, and so that you can actually get a team that can actually work and move a metric.”
Startups Must Centralize Growth Teams Before Decentralizing Into Product Teams
“I think the answer at an earliest stage of your growth, I think they should be a standalone team. I think it's for two reasons. One is I think it's the, is for the best practices, meaning that they can learn from each other and then they can go solve problems …”
Early-stage startups should hire for immediate needs, not 18-month scale
“But the earliest stages, I actually hired for what I needed right now, because there's no point in hiring someone who will be so valuable for you in 18 months and who can influence everything, but can't build your dashboard.”
Narayanan Advised OpenAI to Prioritize Influence Over Stats Skills for Growth
“And when I talked to OpenAI, they asked me who should be hiring for the head of analytics and head of growth and so on. I said, oh, someone who's looking at a rocket ship, don't worry whether they are statisticians or their influence is the most important thin…”
Facebook's Chris Cox Required Storytelling, Not Raw Data, to Be Influenced
“For example, Harvey, you go to try to influence Harvey. You just throw the data. Don't give me anything other than just data. Just tell me the data. Don't tell me the story. You got a Chris Cox. Don't just throw data at me. Tell me the story, please.”
Narayanan: Evaluate job candidates as skill profiles with distinct peaks
“I don't think about a person as a person. I think of them as a body of skills. So what that basically means that are they Peaking in one or two or three different things and not a liability in the others.”
Narayanan: Employees leave when any of four job satisfaction pillars fail
“It's for four, four different reasons. One is they love what they do. Number two, they love the people they work with. Number three, they Feel like they can learn from the people that they work with and for the company is going up into the right. If one of the…”
Narayanan: Core data analysis requires only indexing and asking 'so what?'
“I'd also say that in terms of analytics itself, there are literally only two things you need to do. One is indexing. Which is you want to see if things are unindexed or overindexed in anything you're comparing and benchmarking. And the second thing is asking t…”
Narayanan: Asking 'so what?' separates top data leaders from average analysts
“And what I've realized was the difference between good analytical people and the, who can be good at insights, but the ones that can, that are good at actionable insight, the muscle is really the so what question. It's not the analysis. They can be great at co…”
Narayanan: Prioritizing current achievement over growth rate was my biggest hiring mistake
“Early on, the big mistakes that I used to make, and I make less of it now, I think I'd probably still make them, is I think about slope and asymptote. Asymptote is how good are you? Slope is how fast are you growing? And so what I would hire more for is People…”
High Growth Rate Beats High Initial Capability Over Time Due to Compounding
“People with a slower asymptote, the faster growth is, are going to overtake. And I generally tend to invest in people over a very long period of time, but within reason, within two people, Within slope and this, I know that basically the effect of compounding …”
Sequoia Classified All Portfolio Companies Into Eight Distinct Formulas
“What all the companies at Sequoia, for example, we can classify for the types of companies phase Sequoia had was eight different types of companies, e-commerce, two sided marketplaces you know, consumer subscription, consumer ads, and SaaS obviously, and so on…”
Narayanan: Most large data analytics problems can be reduced to small data problems
“I always have believed every large data problem can be, can actually be brought down to a small data problem. Every large data problem can be brought down to a small, I'm being extreme here. Obviously nothing in Gen AI is like that, but in terms of analytics, …”
Narayanan: Employee underperformance stems from skill, knowledge, or culture gaps
“Three things I look for. One is I think you look at Skill gap, knowledge gap, and value slash culture gap.”
Narayanan: Underperforming employees often thrive when shifted to the right role
“And I've done often many, many times. I've found that the reason why they're not doing well is because they're not in the right. They're not on the right team or not in the right role or in the right thing. And you just need to shift them. And then suddenly th…”
PIPs Fail Because Conflict-Averse Managers Initiate Them Three Months Too Late
“I think when you put up someone on a performance plan, it's three months too late. It's three months before you should have intervened and tried to do the right thing. What happens most of the times is that people put them on the improvement plan when they've …”
Trusted Referrals Are the Only Hiring Method That Actually Works
“Hiring is a terrible process. I mean, I know you ask a ton of questions of what do you look for? What do you look for? And I know that honestly, I can say all I want, It's useless. At the end of it, you, it's easiest when they work with you or you ask referral…”
Narayanan: Executive Performance Falls Into Three Stage-Based Categories
“I think of it as from an exec perspective, I think there are three types of execs. People who know how to take companies from bad to okay. And people who know how to go from okay to good. And there are people who are good at going from good to great.”
Chris Cox Excelled at Scaling Facebook, Not Turnarounds
“I mean, Chris Cox, excellent exec. For going from, at Facebook, Kristoff is excellent at good to great. I don't think he was good at okay to bad to okay”
Narayanan: No Single Executive Can Perform Both Turnarounds and Scaling
“You actually need to go inside a company, you need to do both. But not the same person can do it. You can't get the same person to do both. They don't even think like that.”
Narayanan: Growth teams must use counter metrics to balance competing goals
“One of the things that we don't do enough is counter metrics, and I think I saw that at PayPal and at Facebook, where you would grow a metric like at PayPal, for example, there were two teams. One was growing revenue, and then one was actually stopping revenue…”