Publication

Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children

Crisan, D. R., Tendeiro, J. N., Wanders, R. B. K., van Ravenzwaaij, D., Meijer, R. R. & Hartman, C. A., Dec-2019, In : International Journal of Methods in Psychiatric Research. 28, 4, 11 p., e1795.

Research output: Contribution to journalArticleAcademicpeer-review

APA

Crisan, D. R., Tendeiro, J. N., Wanders, R. B. K., van Ravenzwaaij, D., Meijer, R. R., & Hartman, C. A. (2019). Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children. International Journal of Methods in Psychiatric Research, 28(4), [e1795]. https://doi.org/10.1002/mpr.1795

Author

Crisan, Daniela R. ; Tendeiro, Jorge N. ; Wanders, Rob B. K. ; van Ravenzwaaij, Don ; Meijer, Rob R. ; Hartman, Catharina A. / Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children. In: International Journal of Methods in Psychiatric Research. 2019 ; Vol. 28, No. 4.

Harvard

Crisan, DR, Tendeiro, JN, Wanders, RBK, van Ravenzwaaij, D, Meijer, RR & Hartman, CA 2019, 'Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children', International Journal of Methods in Psychiatric Research, vol. 28, no. 4, e1795. https://doi.org/10.1002/mpr.1795

Standard

Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children. / Crisan, Daniela R.; Tendeiro, Jorge N.; Wanders, Rob B. K.; van Ravenzwaaij, Don; Meijer, Rob R.; Hartman, Catharina A.

In: International Journal of Methods in Psychiatric Research, Vol. 28, No. 4, e1795, 12.2019.

Research output: Contribution to journalArticleAcademicpeer-review

Vancouver

Crisan DR, Tendeiro JN, Wanders RBK, van Ravenzwaaij D, Meijer RR, Hartman CA. Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children. International Journal of Methods in Psychiatric Research. 2019 Dec;28(4). e1795. https://doi.org/10.1002/mpr.1795


BibTeX

@article{802d1cacd76b48da84e55de706e7b802,
title = "Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children",
abstract = "OBJECTIVES: In this study, we examined the consequences of ignoring violations of assumptions underlying the use of sum scores in assessing attention problems (AP) and if psychometrically more refined models improve predictions of relevant outcomes in adulthood.METHODS: Tracking Adolescents' Individual Lives data were used. AP symptom properties were examined using the AP scale of the Child Behavior Checklist at age 11. Consequences of model violations were evaluated in relation to psychopathology, educational attainment, financial status, and ability to form relationships in adulthood.RESULTS: Results showed that symptoms differed with respect to information and difficulty. Moreover, evidence of multidimensionality was found, with two groups of items measuring sluggish cognitive tempo and attention deficit hyperactivity disorder symptoms. Item response theory analyses indicated that a bifactor model fitted these data better than other competing models. In terms of accuracy of predicting functional outcomes, sum scores were robust against violations of assumptions in some situations. Nevertheless, AP scores derived from the bifactor model showed some superiority over sum scores.CONCLUSION: These findings show that more accurate predictions of later-life difficulties can be made if one uses a more suitable psychometric model to assess AP severity in children. This has important implications for research and clinical practice.",
keywords = "attention problems score estimates, CBCL, consequences of model violations, item response theory, TRAILS, SLUGGISH COGNITIVE TEMPO, DEFICIT/HYPERACTIVITY DISORDER, BEHAVIOR CHECKLIST, MENTAL-HEALTH, REPORT FORM, ADHD, DIMENSIONS, INVARIANCE, SYMPTOMS",
author = "Crisan, {Daniela R.} and Tendeiro, {Jorge N.} and Wanders, {Rob B. K.} and {van Ravenzwaaij}, Don and Meijer, {Rob R.} and Hartman, {Catharina A.}",
note = "{\circledC} 2019 The Authors International Journal of Methods in Psychiatric Research Published by John Wiley & Sons Ltd.",
year = "2019",
month = "12",
doi = "10.1002/mpr.1795",
language = "English",
volume = "28",
journal = "International Journal of Methods in Psychiatric Research",
issn = "1049-8931",
publisher = "Wiley",
number = "4",

}

RIS

TY - JOUR

T1 - Practical consequences of model misfit when using rating scales to assess the severity of attention problems in children

AU - Crisan, Daniela R.

AU - Tendeiro, Jorge N.

AU - Wanders, Rob B. K.

AU - van Ravenzwaaij, Don

AU - Meijer, Rob R.

AU - Hartman, Catharina A.

N1 - © 2019 The Authors International Journal of Methods in Psychiatric Research Published by John Wiley & Sons Ltd.

PY - 2019/12

Y1 - 2019/12

N2 - OBJECTIVES: In this study, we examined the consequences of ignoring violations of assumptions underlying the use of sum scores in assessing attention problems (AP) and if psychometrically more refined models improve predictions of relevant outcomes in adulthood.METHODS: Tracking Adolescents' Individual Lives data were used. AP symptom properties were examined using the AP scale of the Child Behavior Checklist at age 11. Consequences of model violations were evaluated in relation to psychopathology, educational attainment, financial status, and ability to form relationships in adulthood.RESULTS: Results showed that symptoms differed with respect to information and difficulty. Moreover, evidence of multidimensionality was found, with two groups of items measuring sluggish cognitive tempo and attention deficit hyperactivity disorder symptoms. Item response theory analyses indicated that a bifactor model fitted these data better than other competing models. In terms of accuracy of predicting functional outcomes, sum scores were robust against violations of assumptions in some situations. Nevertheless, AP scores derived from the bifactor model showed some superiority over sum scores.CONCLUSION: These findings show that more accurate predictions of later-life difficulties can be made if one uses a more suitable psychometric model to assess AP severity in children. This has important implications for research and clinical practice.

AB - OBJECTIVES: In this study, we examined the consequences of ignoring violations of assumptions underlying the use of sum scores in assessing attention problems (AP) and if psychometrically more refined models improve predictions of relevant outcomes in adulthood.METHODS: Tracking Adolescents' Individual Lives data were used. AP symptom properties were examined using the AP scale of the Child Behavior Checklist at age 11. Consequences of model violations were evaluated in relation to psychopathology, educational attainment, financial status, and ability to form relationships in adulthood.RESULTS: Results showed that symptoms differed with respect to information and difficulty. Moreover, evidence of multidimensionality was found, with two groups of items measuring sluggish cognitive tempo and attention deficit hyperactivity disorder symptoms. Item response theory analyses indicated that a bifactor model fitted these data better than other competing models. In terms of accuracy of predicting functional outcomes, sum scores were robust against violations of assumptions in some situations. Nevertheless, AP scores derived from the bifactor model showed some superiority over sum scores.CONCLUSION: These findings show that more accurate predictions of later-life difficulties can be made if one uses a more suitable psychometric model to assess AP severity in children. This has important implications for research and clinical practice.

KW - attention problems score estimates

KW - CBCL

KW - consequences of model violations

KW - item response theory

KW - TRAILS

KW - SLUGGISH COGNITIVE TEMPO

KW - DEFICIT/HYPERACTIVITY DISORDER

KW - BEHAVIOR CHECKLIST

KW - MENTAL-HEALTH

KW - REPORT FORM

KW - ADHD

KW - DIMENSIONS

KW - INVARIANCE

KW - SYMPTOMS

U2 - 10.1002/mpr.1795

DO - 10.1002/mpr.1795

M3 - Article

VL - 28

JO - International Journal of Methods in Psychiatric Research

JF - International Journal of Methods in Psychiatric Research

SN - 1049-8931

IS - 4

M1 - e1795

ER -

ID: 95849460