Publication

Improving confidence intervals for normed test scores: Include uncertainty due to sampling variability

Voncken, L., Albers, C. J. & Timmerman, M. E., Apr-2019, In : Behavior Research Methods. 51, 2, p. 826–839 14 p.

Research output: Contribution to journalArticleAcademicpeer-review

Test publishers usually provide confidence intervals (CIs) for normed test scores that reflect the uncertainty due to the unreliability of the tests. The uncertainty due to sampling variability in the norming phase is ignored. To express uncertainty due to norming, we propose a flexible method that is applicable in continuous norming and allows for a variety of score distributions, using Generalized Additive Models for Location, Scale, and Shape (GAMLSS; Rigby & Stasinopoulos, 2005). We assessed the performance of this method in a simulation study, by examining the quality of the resulting CIs. We varied the population model, procedure of estimating the CI, confidence level, sample size, value of the predictor, extremity of the test score, and type of variance-covariance matrix. The results showed that good quality of the CIs could be achieved in most conditions. The method is illustrated using normative data of the SON-R 6-40 test. We recommend test developers to use this approach to arrive at CIs, and thus properly express the uncertainty due to norm sampling fluctuations, in the context of continuous norming. Adopting this approach will help (e.g., clinical) practitioners to obtain a fair picture of the person assessed.
Original languageEnglish
Pages (from-to)826–839
Number of pages14
JournalBehavior Research Methods
Volume51
Issue number2
Early online date6-Nov-2018
Publication statusPublished - Apr-2019

    Keywords

  • CORRELATION MATRIX

View graph of relations

Download statistics

No data available

ID: 64310473