Publication

The use of secondary school student ratings of their teacher’s skillfulness for low-stake assessment and high-stake evaluation

van der Lans, R. M. & Maulana, R., 1-Sep-2018, In : Studies in Educational Evaluation. 58, p. 112–121 10 p.

Research output: Contribution to journalArticleAcademicpeer-review

Copy link to clipboard

Documents

  • The use of secondary school student ratings of their teacher’s skillfulness for low-stake assessment and high-stake evaluation

    Final publisher's version, 735 KB, PDF document

    Request copy

DOI

Previous studies in higher education have shown that the reliability of student ratings of teaching skill increases if multiple ratings by different students are aggregated. This study examines the generalizability of these findings to the context of secondary education. Also, it seeks to validate these findings by comparing reliability levels estimated by the routinely used nested design with those estimated using a more complex design. The sample consisted of 410 students from 17 classes rating 63 teachers working at eight schools across the Netherlands. Using the nested design, the study replicates findings of previous studies in higher education. The findings illustrate how the reliability level of secondary school students’ ratings increases with an increasing number of students. However, these replicated reliability levels were not validated by the more complex design which provided lower estimates. This indicates that the nested design may not provide accurate estimations of rating reliability.
Original languageEnglish
Pages (from-to)112–121
Number of pages10
JournalStudies in Educational Evaluation
Volume58
Publication statusPublished - 1-Sep-2018

    Keywords

  • Teacher evaluation, Teacher assessment, Student ratings, SET, Reliability, Generalizability theory, TEACHING EFFECTIVENESS, GENERALIZABILITY THEORY, STABILITY, MODELS

ID: 61923302