A critique to Akdemir and Oguz (2008): Methodological and statistical issues to consider when conducting educational experiments

Albers, C. J., Boevé, A. J. & Meijer, R. R., Sep-2015, In : Computers & Education. 87, p. 238-242 5 p.

Research output: Contribution to journalArticleAcademicpeer-review

Copy link to clipboard



Abstract In the paper “Computer-based testing: An alternative for the assessment of Turkish undergraduate students”, Akdemir and Oguz (2008) discuss an experiment to compare student performance in paper-and-pencil tests with computer-based tests, and conclude that students taking computer-based tests do not underperform compared to students taking pen-and-pencil tests. In this letter, we indicate two severe methodological and statistical flaws in this paper. We show how, in general, such flaws can affect experimental research. Due to these flaws, the conclusions by Akdemir and Oguz are unfounded: one cannot reach these conclusions on basis of this design and analysis. We provide a set of guidelines and advices to avoid methodological problems when setting up an educational experiment.
Original languageEnglish
Pages (from-to)238-242
Number of pages5
JournalComputers & Education
Publication statusPublished - Sep-2015


  • Evaluation methodologies, Methodology in education, Statistics

Download statistics

No data available

ID: 21975054