Once is not enough: Establishing reliability criteria for feedback and evaluative decsions based on classroom observation

van der Lans, R. M., van de Grift, W. J. C. M., van Veen, K. & Fokkens-Bruinsma, M., 7-Sep-2016, In : Studies in Educational Evaluation. 50, September, p. 88-95 8 p.

Research output: Contribution to journalArticleAcademicpeer-review

Copy link to clipboard


  • Once is not enough Establishing reliability criteria

    Final publisher's version, 699 KB, PDF document

    Request copy


Implementation of effective teacher evaluation procedures is a global challenge in which lowering the chances that teachers receive inaccurate evaluations is a pertinent goal. This study investigates the minimum number of observations required to guarantee that teachers receive feedback with modest reliability (Eρ2 ≥ .70) and that any summative decisions about their professional career have high reliability (Eρ2 ≥ .90). A sample of 198 classroom observations by 62 colleagues of 69 teachers working at eight schools reveals that reliable feedback requires at least three lesson visits by three different observers and that reliable summative decisions require more than 10 visits. These findings mirror those reported through other observation instruments. This study accordingly offers directions for how schools can implement such procedures most cost-effectively.
Original languageEnglish
Pages (from-to)88-95
Number of pages8
JournalStudies in Educational Evaluation
Issue numberSeptember
Publication statusPublished - 7-Sep-2016


  • Teacher evaluation, Classroom observation, Teacher feedback, RELIABILITY, Generalizability theory, ITEM RESPONSE THEORY
Related Publications
  1. Once is not enough: Establishing reliability criteria for teacher evaluation based on classroom observations

    van der Lans, R., van de Grift, W. & van Veen, K., 10-Apr-2016.

    Research output: Contribution to conferencePosterAcademic

View all (1) »

View graph of relations

ID: 35564960