Publication

On the "association between two things": the case of student surveys and classroom observations of teaching quality

van der Lans, R. M., Nov-2018, In : Educational assessment evaluation and accountability. 30, 4, p. 347–366 20 p.

Research output: Contribution to journalArticleAcademicpeer-review

  • Rikkert M. van der Lans
This study examines the association between two measures of teaching effectiveness—a student survey measure and a classroom observation measure—to determine whether their correlation depends on the study design. The sample includes 160 classroom observations of 56 teachers across 15 classes, in which students also rated the teachers with a survey. Dependencies are examined using generalizability theory. Results suggest that the correlation between the survey and observation measures depends on the number of classroom observations, the number of student ratings, and whether the designs are nested or partially nested. The effect is substantial: Predicted correlations range between 0.10–0.80 for the same variables with different study designs. In particular, the number of classroom observations has a notable influence, such that across all investigated scenarios, the correlation doubles when observers visit three lessons instead of one. Correlations also tend to be positively biased when research designs are nested.
Original languageEnglish
Pages (from-to)347–366
Number of pages20
JournalEducational assessment evaluation and accountability
Volume30
Issue number4
Early online date20-Aug-2018
Publication statusPublished - Nov-2018

    Keywords

  • GENERALIZABILITY THEORY, EVALUATION INSTRUMENT, RELIABILITY, TEACHERS, VALIDITY, FEEDBACK, MODEL, BEHAVIORS, LESSONS, RATINGS

Download statistics

No data available

ID: 64277178