Top

Journal of Psychopathology and Behavioral Assessment

Gepubliceerd in:

01-03-2025

Randomized Controlled Trial of the Effects of Order of Item Administration on Parent Ratings of Child and Adolescent Dispositions and Psychopathology

Auteurs: Brooks Applegate, Benjamin B. Lahey

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 1/2025

Abstract

The effects of serial order of presentation on parent ratings of items referring to the behavior of their children were examined using two scales measuring dispositions and psychopathology that were administered to a representative sample of 1,358 4–17 year olds. Items within each scale were pseudo-randomized instead of being grouped according to the constructs they were written to measure. Each scale was presented in either forward or reverse serial order, with parents who were unaware of all hypotheses being randomly selected for forward or reverse order of administration. In both the disposition and psychopathology scales, the same items were rated significantly differently depending on the order of presentation to the raters; ratings declined in magnitude as the parents rated increasing numbers of items. Although parent ratings presumably partly reflect the behavior of their children, they are biased by robust order effects. The unbiased counter-balancing of items in scale construction and the use of randomized forward versus reverse orders of scale administrations can be used to minimize extraneous order effects.

vorige artikel Development and Evaluation of the Religious and Spiritual Struggles Scale-5 (RSS-5)

volgende artikel Measuring Self-Referent Memory Bias as Marker for Depression: Overview, New Insights, and Recommendations

Achenbach, T. M., Howell, C. T., Quay, H. C., & Conners, C. K. (1991). National survey of problems and competences among 4 to 16 year-olds: Parents reports for normative and clinical samples. Monographs of the Society for Research in Child Development, 56, R5–R119.

Carleton, R., Thibodeau, N., Osborne, M. A., J., W., & Asmundson, G. J. G. (2012). Exploring item order in anxiety-related constructs: Practical impacts of serial position. Practical Assessment Research & Evaluation, 17, 1–15. https://doi.org/10.7275/e43n-cn20CrossRef

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.)). Lawrence Erlbaum.

Conners, C. K., Sitarenios, G., Parker, J. D. A., & Epstein, J. N. (1998). The revised Conners’ parent rating scale (CPRS-R): Factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26(4), 257–268. https://doi.org/10.1023/a:1022602400621CrossRefPubMed

Crick, N. R., & Grotpeter, J. K. (1995). Relational aggression, gender, and social-psychological adjustment. Child Development, 66(3), 710–722. https://doi.org/10.2307/1131945CrossRefPubMed

Dodge, K. A., & Coie, J. D. (1987). Social-information-processing factors in reactive and proactive aggression in children’s peer groups. Journal of Personality and Social Psychology, 53, 1146–1158.PubMed

Elliott, D. S., & Huizinga, D. (1983). Social class and delinquent behavior in a national youth panel. Criminology: An Interdisciplinary Journal, 21, 149–177.

Jensen, P. S., Watanabe, H. K., & Richters, J. E. (1999). Who’s up first? Testing for order effects in structured interviews using a counterbalanced experimental design. Journal of Abnormal Child Psychology, 27(6), 439–445. https://doi.org/10.1023/a:1021927909027CrossRefPubMed

Knowles, E., S., & Byers, B. (1996). Reliability shifts in measurement reactivity: Driven by content engagement or self-engagement? Journal of Personality and Social Psychology, 70(5), 1080–1090. https://doi.org/10.1037/0022-3514.70.5.1080CrossRefPubMed

Knowles, E. S., & Condon, C. A. (2000). Does the rose still smell as sweet? Item variability across test forms and revisions. Psychological Assessment, 12, 245–252. https://doi.org/10.1037/1040-3590.12.3.245CrossRefPubMed

Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., & Wright, A. G. C. (2021). The Hierarchical Taxonomy of Psychopathology (HiTOP): A quantitative nosology based on consensus of evidence. Annual Review of Clinical Psychology, 17(1), null. https://doi.org/10.1146/annurev-clinpsy-081219-093304

Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50(1), 537–567. https://doi.org/10.1146/annuarev.psych.50.1.537CrossRefPubMed

Lahey, B. B., Applegate, B., Waldman, I. D., Loft, J. D., Hankin, B. L., & Rick, J. (2004). The structure of child and adolescent psychopathology: Generating new hypotheses. Journal of Abnormal Psychology, 113, 358–385.PubMed

Lahey, B. B., Applegate, B., Chronis, A. M., Jones, H. A., Williams, S. H., Loney, J., & Waldman, I. D. (2008a). Psychometric characteristics of a measure of emotional dispositions developed to test a developmental propensity model of conduct disorder. Journal of Clinical Child and Adolescent Psychology, 37, 794–807.PubMedPubMedCentral

Lahey, B. B., Rathouz, P. J., Applegate, B., Van Hulle, C., Garriock, H. A., Urbano, R. C., & Waldman, I. D. (2008b). Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology, 36, 187–206.PubMed

Lahey, B. B., Rathouz, P. J., Applegate, B., Tackett, J. L., & Waldman, I. D. (2010). Psychometrics of a self-report version of the child and adolescent dispositions scale. Journal of Clinical Child and Adolescent Psychology, 39, 351–361.PubMedPubMedCentral

Lahey, B. B., Class, Q. A., Zald, D. H., Rathouz, P. J., Applegate, B., & Waldman, I. D. (2018). Prospective test of the developmental propensity model of antisocial behavior: From childhood and adolescence into early adulthood. Journal of Child Psychology and Psychiatry, 59, 676–683.PubMed

Loney, J. (1987). Hyperactivity and aggression in the diagnosis of attention-deficit disorder. Advances in Clinical Child Psychology, 10, 99–135.

Mischel, W. (2004). Toward am integrative science of the person. Annual Review of Psychology, 55, 1–22. https://doi.org/10.1146/annurev.psych.55.042902.130709CrossRefPubMed

Quay, H. C., & Peterson, D. R. (1960). Personality factors in the study of juvenile delinquency. Exceptional Children, 26(9), 472–.

Schell, K. L., & Oswald, F. L. (2013). Item grouping and item randomization in personality measurement. Personality and Individual Differences, 55(3), 317–321. https://doi.org/10.1016/j.paid.2013.03.008CrossRef

Schuman, H., Presser, S., & Ludwing, J. (1981). Context effects om survey responses to questions about abortion. Public Opinion Quarterly, 45(2), 216–223. https://doi.org/10.1086/268652CrossRef

Serico, J. M., NeMoyer, A., Goldstein, N. E. S., Houck, M., & Leff, S. S. (2021). A methodological study of Order effects in reporting relational aggression experiences. Journal of Interpersonal Violence, 36(5–6), 2478–2497. https://doi.org/10.1177/0886260518760008CrossRefPubMed

Shaffer, D., Fisher, P., Dulcan, M., Piacentini, K., Schwab-Stine, J., Lahey, M. E., Bourdon, B. B., Jensen, K., Bird, P. S., H., R., & Regier, D., A (1996). The NIMH Diagnostic interview schedule for Children Version 2.3 (DISC-2.3): Description, accessibility, prevenance rates, and performance in the MECA Study. Methods for the epidemiology of child and adolescent mental disorders study. Journal of the American Academy of Child and Adolescent Psychiatry, 35(7), 865–877. https://doi.org/10.1097/00004583-1996070000-00012CrossRefPubMed

Shaffer, D., Fisher, P., Lucus, C., Dulcan, P., M., K., & Schwab-Stine, M., E (2000). Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child and Adolescent Psychiatry, 39(1), 28–38. NIMH Diagnostic Interview Schedule for Children Version IV (HIMH DISC-IV). https://doi.org/10.1097/00004583-20001000-00014

Suárez-Alvarez, J., Pedrosa, I., Lozano, L., García-Cueto, M., Cuesta, E., M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice, Psicothema, 2018, 30 (2), 149–158. https://doi.org/10.7334/psicothema2018.33

Wald, A., & Wolfowitz, J. (1940). On a test whether two samples are from the same population. Annals of Mathematical Statistics, 11, 147–162.

Waszczuk, M. A., Kotov, R., Ruggero, C., Gamez, W., & Watson, D. (2017). Hierarchical structure of emotional disorders: From individual symptoms to the Spectrum. Journal of Abnormal Psychology, 126(5), 613–634. https://doi.org/10.1037/abn0000264CrossRefPubMed

Titel: Randomized Controlled Trial of the Effects of Order of Item Administration on Parent Ratings of Child and Adolescent Dispositions and Psychopathology
Auteurs: Brooks Applegate
Benjamin B. Lahey
Publicatiedatum: 01-03-2025
Uitgeverij: Springer US
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment / Uitgave 1/2025
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI: https://doi.org/10.1007/s10862-024-10184-7

Andere artikelen Uitgave 1/2025

Personality Disorders, Attachment, and Social Cognition

Differential Item Functioning for Gender and Age of the DSM-IV Borderline Personality Disorder Criteria in a Large Clinical Sample

Open Access

Investigating the Psychometric Properties and Measurement Invariance of the Forms of Self-Criticizing/Attacking and Self-Reassuring Scale in Veteran Men and Women

A Behavioral Paradigm to Assess for Change in Difficulty Discarding Clutter in the Home: Psychometric Properties of the Hoarding Behavioral Approach Task (H-BAT)

Child Emotional Characteristics as Predictors of Informant Disagreement in Oppositional Defiant Symptomatology

Open Access

Bohn Stafleu van Loghum

Welkom bij Scalda & Bohn Stafleu van Loghum

Registreer

Login

Randomized Controlled Trial of the Effects of Order of Item Administration on Parent Ratings of Child and Adolescent Dispositions and Psychopathology

Abstract

Andere artikelen Uitgave 1/2025

Personality Disorders, Attachment, and Social Cognition

Differential Item Functioning for Gender and Age of the DSM-IV Borderline Personality Disorder Criteria in a Large Clinical Sample

Investigating the Psychometric Properties and Measurement Invariance of the Forms of Self-Criticizing/Attacking and Self-Reassuring Scale in Veteran Men and Women

A Behavioral Paradigm to Assess for Change in Difficulty Discarding Clutter in the Home: Psychometric Properties of the Hoarding Behavioral Approach Task (H-BAT)

Child Emotional Characteristics as Predictors of Informant Disagreement in Oppositional Defiant Symptomatology

Differences in Associations Between Autonomic Nervous System Activity and Psychopathic Traits Across Stress Paradigms and Measures

Bohn Stafleu van Loghum

Welkom bij Scalda & Bohn Stafleu van Loghum

Registreer

Login

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Personality Disorders, Attachment, and Social Cognition

Differential Item Functioning for Gender and Age of the DSM-IV Borderline Personality Disorder Criteria in a Large Clinical Sample

Investigating the Psychometric Properties and Measurement Invariance of the Forms of Self-Criticizing/Attacking and Self-Reassuring Scale in Veteran Men and Women

A Behavioral Paradigm to Assess for Change in Difficulty Discarding Clutter in the Home: Psychometric Properties of the Hoarding Behavioral Approach Task (H-BAT)

Child Emotional Characteristics as Predictors of Informant Disagreement in Oppositional Defiant Symptomatology

Differences in Associations Between Autonomic Nervous System Activity and Psychopathic Traits Across Stress Paradigms and Measures