Educational Technology: Metrics or Myth?

Context

Your company sells an early warning system marketed to boost student retention. Recent independent research, however, challenges the causal link between system use and increased retention, suggesting the perceived benefits are misleading.

Dilemma

A) Publicly acknowledge the research findings, adjust marketing to reflect the true capabilities of your system, and collaborate with researchers for further validation, risking immediate sales decline.

B) Continue current marketing emphasizing retention, citing anecdotal evidence and downplaying contradictory research, prioritizing sales and market position.

Summary

Researchers have cast doubt on Purdue University’s claims that its early-warning system, Signals, improves student retention. Analyses suggest the system’s perceived impact is a result of students persisting in their studies rather than Signals causing higher retention. Purdue defended its findings but acknowledged more research is needed. While Signals-inspired systems remain valuable for academic support, experts stress the need for rigorous validation of ed-tech claims.

Resources:

• https://www.insidehighered.com/news/2013/11/06/researchers-cast-doubt-about-early-warning-systems-effect-retention
• https://eliterate.us/course-signals-effectiveness-data-appears-meaningless-care/