Lee: Traditional mirror-room focus group game testing produces useless feedback
Elan Lee · Find co-creators everywhere (with Exploding Kittens Inc.’s Elan Lee) | Masters of Scale · Dec 12, 2023 · at 34:26
Elan Lee, CEO and co-founder of Exploding Kittens, explains why he rejected the board game industry's standard focus-group testing methods.
0:00 / 0:20exact quote · 20.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Traditionally, the way that game testing works is you hire a group. They do these blind tests. Everyone sits in a room. There's the one-way mirror. You watch people play the games. It's horrible. And I looked at that trying to figure out like, why are these tests so bad? Why are we pouring all this money into it and literally learning nothing? And the reason is because nobody plays games like that. None of that feels natural.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Elan Lee
Elan Lee: Games should make players entertaining, not be inherently entertaining
“My fundamental premise behind all game design is that games should not be entertaining. Games should make the people you're playing with entertaining.”
Elan Lee: AI fails at designing games that spotlight player interaction
“Games should make the people you're playing with entertaining. And AI sucks at that.”
Lee: Most crowdfunding projects focus entirely on funding and ignore the crowd
“All the projects you've ever seen in your life focus on that funding part and they ignore the crowd part.”
Elan Lee: AI compresses game ideation from months to hours
“And it used to take, you know, months or years. And with AI, I've actually been able to shorten that to sometimes just a few hours.”
Elan Lee: AI accelerates brainstorming by filtering bad ideas faster
“It often won't yield the right idea, but I can usually shortcut weeks Off the process, because it helps me get through all the bad stuff faster, and it helps me find the little tiny sparks that might be interesting, and then I can grab those and dive right in.”
Elan Lee: AI enables lightning-fast combinatorial ideation for human creators
“For those who don't have a Jordan, AI serves that purpose perfectly because it will do that combinatorial mathematics at lightning speed. All you have to do is be really astute and really open-minded as you look at the results and find the two ingredients that…”