May 22, 2017 · 1h 15m · capital-allocators
Charley Ellis – Multiple Ways to Win (Capital Allocators, EP.08)
0:00 / 0:00
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of Capital Allocators, host Ted Seides interviews asset management luminary Charley Ellis to explore the structural evolution of financial markets, the compelling logic behind indexing, and the unique organizational cultures of elite institutions like Vanguard, Capital Group, and Yale. Ellis shares foundational insights from his landmark works 'The Loser's Game' and 'The Index Revolution,' combining rigorous institutional analysis with enduring wisdom on governance, mentorship, and life philosophy.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Ted holds 27.5% of the talking time here. How this is scored →
Ted as informed peer 3.3 Guest teaching 2.7 Guest disagreement 0.3 Ted pushing back 0.2
speaking balance: gold is Ted, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 32:40 Direct dismissal of active managers overcoming cost hurdles
Charlie emphatically dismisses the notion that modern managers can beat the market after fees, pointing out that 84% to 87% fail their benchmarks.
Hardest push from Ted ▶ 41:55 Ted pushes back on Capital Group versus S&P index turnoverTed challenges Charlie's praise of Capital Group's long horizon by noting the S&P 500 index inherently maintains low turnover as well.
Biggest teaching moment ▶ 42:00 Charlie reframes fundamental conviction versus passive holdingCharlie immediately schools Ted on the difference between passive mechanical low turnover and proactive fundamental research conviction.
Ted holds their own ▶ 51:49 Ted cites precise historical performance stats from YaleTed demonstrates deep domain expertise by citing specific multi-year underperformance numbers (40% cumulative drawdown) at the Yale endowment.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Ted as informed peer | Guest teaching | Guest disagreement | Ted pushing back | Why |
|---|---|---|---|---|---|---|
| Podcast Mission Statement and Regulatory Legal Disclaimer | 0 | 0 | 0 | 0 | Monologue segment comprising sponsor reads, the podcast mission introduction, and legal disclaimers. Because there is no dialogue or interview dynamic present, all interaction metrics are scored at zero. | |
| Early Career Mentorship and Advice on Writing Books | 3 | 2 | 0 | 0 | Ted opens the interview by expressing deep personal gratitude for Charlie's early career mentorship and advice on book writing. The rapport is exceptionally warm, collegial, and nostalgic with zero friction. | |
| The Archaic State of Equity Research in the 1960s | 3 | 4 | 0 | 0 | Charlie describes the primitive nature of 1960s equity research, using slide rules and visiting SEC library filing rooms. Ted asks structured, facilitating questions to draw out historical contrasts. | |
| Founding Greenwich Associates to Benchmark Institutional Performance | 3 | 3 | 0 | 0 | Charlie explains the genesis of Greenwich Associates, identifying the blind spot institutions had regarding client perception. Ted listens closely as Charlie details how rigorous benchmarking changed institutional consulting. | |
| Formulating The Loser's Game and Active Underperformance | 4 | 4 | 1 | 1 | Ted probes how Charlie deduced that professional active management was a 'loser's game' even when individual trading dominated the 1970s. Charlie explains that brilliant managers inevitably cancel each other out in aggregate. | |
| Investor Self-Definition and the Naval Aviation Analogy | 4 | 3 | 0 | 0 | Charlie illustrates the division between policy formation and tactical execution using the analogy of naval aviation. Ted chimes in with supportive color as Charlie emphasizes knowing oneself as an investor. | |
| Institutional Dominance, Technology Shifts, and Market Cost Frictions | 3 | 5 | 2 | 0 | Charlie delivers an exhaustive breakdown of why beating the market is near impossible today due to high fees, technology saturation, and 99% institutional trading. Ted listens as Charlie cites grim 10-year underperformance statistics. | |
| Sponsor Message: Ridgeline AI-Native Investment Technology Platform | 4 | 3 | 0 | 0 | Following a sponsor read, Ted asks how Vanguard successfully manages active strategies. Charlie credits their low fee structure and ruthless objectivity in manager selection. | |
| Capital Group's Sub-Portfolio Architecture and Long-Term Horizon | 4 | 4 | 2 | 2 | Ted asks how Capital Group differs from passive indexing if both rely on low turnover. Charlie immediately clarifies the essential difference between mechanical low turnover and high-conviction, long-horizon fundamental valuation. | |
| Capital Group's Culture, Leadership, and Deep Listening | 4 | 3 | 0 | 0 | Charlie details Capital Group's organizational philosophy, highlighting small team architecture, deep listening skills, and long employee tenure. Ted validates the rarity of effective leadership in the asset management industry. | |
| Yale Endowment and David Swensen's Analytical Brilliance | 4 | 3 | 0 | 0 | The conversation shifts to David Swensen and the Yale Endowment. Charlie breaks down Swensen's analytical brilliance, starting from pioneering interest rate swaps at Salomon Brothers to building an unreplicable network. | |
| Institutional Governance and Yale's Rigorous Annual Review Process | 6 | 3 | 0 | 1 | Ted shares a detailed historical case where Yale's domestic equities lagged the benchmark by 40% over five years without firing managers. Charlie provides inside context on Yale's rigorous annual review process and governance discipline. | |
| Finding Purpose and Defining Career Paths in Asset Management | 4 | 3 | 1 | 0 | Ted asks how aspiring professionals should reconcile a love for investing with the reality of efficient markets. Charlie advises entering the field only for intrinsic fascination or advisory problem-solving, not quick riches. | |
| Personal Reflections on Marriage, Partnership, and Linda Lorimer | 3 | 1 | 0 | 0 | Ted reads an excerpt written by Charlie on marriage and family, inviting him to reflect. Charlie offers a heartfelt tribute to his wife, Linda Lorimer, and the power of intellectual and personal partnership. | |
| Work as Play, Life Productivity, and Redefining Retirement | 2 | 2 | 0 | 0 | Asked about wasting time, Charlie rejects the premise by noting he views all his work as play and has felt 'retired' since age 30. The tone is deeply reflective and enthusiastic about daily productivity. | |
| Cherished Athletic Memories: Father-Son Ping-Pong and Powder Skiing | 2 | 1 | 0 | 0 | Charlie shares vivid personal memories, including the triumph of his son beating him at ping-pong after years of serious matches and heli-skiing untouched powder in the Bugaboo Mountains. | |
| Fortuitous Career Investments: Berkshire Hathaway and John Neff | 4 | 3 | 0 | 0 | After recounting a venture investing misstep, Charlie details serendipitous career investments in Berkshire Hathaway at $500/share and John Neff's discounted dual-purpose shares. | |
| Final Reflections from the Rocking Chair: Gratitude and Country | 3 | 1 | 0 | 0 | Ted asks the traditional closing 'rocking chair' question. Charlie expresses profound gratitude for his career, family, educational opportunities, and country. |
Statements from this episode (25)
Ellis: Swensen initially opposed Yale Endowment staff leaving for business school
“Particularly glad that you did go, because I know David had some reservations in those days. He's modified his views since then.”
Ellis: In early 1960s, asset managers were either wealthy or confused
“In my time getting in the 19, early 19 sixties, anybody went into investment management either had a wealthy family, and he was kind of looking out for the family's money, Or had made a mistake and didn't know what he was doing.”
Ellis: Asset management saw one of history's greatest industry booms
“In the shadows, right behind me, was coming what has got to be one of the greatest booms any line of work has ever had in the history of the world.”
Ellis: 1960s equity research was formulaic and backward-looking
“First, there was almost no research available. Standard & Poor's put out six by eight inch, one side piece of paper, left-hand side would be all the history, and the right-hand side would be the stock price. It was all very formulaic and totally useless, becau…”
Ellis: Over 90% of 1960s Market Trading Was Done by Retail Individuals
“91, two, three percent would be done by individuals, and they bought or sold stock every year or two, and almost exactly half of their trading was done In odd locks of AT&T common stock.”
Ellis: 1960s Insurance Equities Teams Lacked Top Talent and Fierce Competition
“In the insurance business, the smartest guys went into sales. The second smartest guys went into lending, because most of the insurance portfolios were debt, and the dumb guys went into the equity side, because they needed something to do, and so that was not …”
Ellis: Financial institutions operate blindly regarding customer standing and competitive positioning
“Everybody who's involved in financial services. I thought primarily through the stock brokerage business and the investment management business. Same thing's true of banking, investment banking, bond dealing, whatever. You don't know how you stand with your cu…”
Ellis: Top ten investment management firms rapidly lose top rankings over ten years
“If you record over time, systematically, who are the best firms as judged by their clients, institutions like pension funds, if you're doing that, and you get to know the firms that are the 10 best, and you come back five years later, and half of the 10 best a…”
Ellis: Family portfolio is fully indexed except for Berkshire Hathaway
“For myself, for my wife, for my sons and for my grandchildren, it's all indexed with one exception and the one exception, which you and I both know is Warren Buffett. I lucked into understanding Berkshire Hathaway way back in the seventies, and I'm not about t…”
Ellis: Institutional market share rose from 9% to 99%
“Used to be nine percent was institutional, and now it's 99%.”
Ellis: Overcoming fees and transaction costs requires 33% outperformance
“With certain carefully identified exceptions, you, not only is it very difficult, you won't, and you almost can't, outperform the market after two big things. And it doesn't look big when you say it, only one percent. But if you say, wait a minute, seven perce…”
Ellis: Over 10 years, 84% of US and 87% of UK active funds underperformed
“If you do that, in the United States, the last 10 years, 84% of actively managed mutual funds underperformed the market they chose to beat, and then just for interest, You see the same information for the UK? There, it's 87% underperformed.”
Seides: One Trillion of Vanguard's Assets Are Actively Managed
“Three trillion in assets. What a lot of people don't know is one trillion is actively managed.”
Ellis: Vanguard's Active Outperformance Is Driven by Low Negotiated Fees
“They are really good at it, but the real secret to success for Vanguard is that they've negotiated low fees on behalf of their investor clients, so they pass them on, and the low fees really, really matter.”
Ellis: Selecting Active Managers for Vanguard Is the Hardest Job in Asset Management
“And I personally think the hardest job that I know of in investment management Is to be the new guy who's taken on the responsibility on behalf of Vanguard to select active managers that you will now deploy funds with. That is going to be a terribly difficult …”
Ellis: David Swensen created the first derivative swap at Salomon Brothers
“The first derivative ever done was done by David Swenson when he was working at Salomon Brothers. It was an interest rate swap between IBM and the World Bank”
Ellis: The Yale model under David Swensen is virtually impossible to replicate
“You take all the different comparative advantages that Yale has in David Swenson as their chief investment officer, and it's virtually impossible to replicate.”
Ellis: Yale Endowment grew 25x from $1B under David Swensen
“When David first arrived, they had one billion dollars, and now they got roughly 25 times that, and they've spewed money out to the university year after year after year after year after year.”
Seides: Yale's US equity managers underperformed by 40% without firings
“From 1994 to 1999, that five year period, Yale's U.S. Equity managers that they hired underperformed the market by 40 percentage points cumulatively. Eight percent per year for five years. Not a single manager was fired.”
Ellis: David Swensen never raised policy changes outside annual reviews in 16 years
“Now, of course, David could later raise a question, but he never did in the 16 years that I was there. Never did.”
Ellis: Most endowment committees should implement portfolios using index funds
“And then, of course, I would say, and probably most of us should implement using index funds.”
Ellis: Investment management will not remain the world's highest-paid line of work
“If you really love investing and you really, really want to do it, and it's not because it's the highest paid line of work in the world, which it is now, but it's not going to stay way up there forever.”
Ellis: Backing a College Classmate in Venture Capital Was a Big Mistake
“I made a horrible mistake of believing that a classmate from college was really smart, which was accurate, And be a great guy to do some venture investing with. And I trusted him, and that was a big mistake.”