St. Charles: Student proficiency is straightforward to validate in edtech
Jesse St. Charles · Jesse St. Charles, Knewton // Data Driven #25 // March 2014 (Hosted by FirstMark Capital) · Mar 20, 2014 · at 13:32
Jesse St. Charles, lead data scientist at Knewton, contrasts the relative ease of validating student proficiency models against harder-to-measure metrics like student engagement.
0:00 / 0:06exact quote · 6.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Estimating student proficiency, relatively straightforward. We can validate that because we actually see that the model itself predicts outcomes.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jesse St. Charles
St. Charles: Modeling conceptual dependencies is beneficial across all subjects
“There is requisite knowledge that you need, and that's where we're trying to model the content that we're working with, and so I guess it's, what, the question is whether or not you buy that there exists requisite relationships in content, and whether respecti…”
St. Charles: Industrial education's one-size-fits-all model leaves everyone underserved
“It is one size fits all. And to me that means that everyone's underserved.”
St. Charles: Student interaction data in educational software goes completely unused
“Students are already generating all this data as they're interacting with these educational products, but they're just falling on the floor. We're not doing anything with it.”
Knewton saw nearly half a grade improvement with a major partner
“But at one of our largest partners, we've seen nearly half a great improvement as usage of adaptive assignments increases.”
St. Charles: Knewton needs partner investment to run controlled studies
“And also because we're a platform, we have to coordinate with partners to actually impact users. And so this gets back to what I was saying before about some of the challenges of running control studies. We actually require explicit and investment by our partn…”