Top

Journal of Psychopathology and Behavioral Assessment

Gepubliceerd in:

01-03-2025

Measuring Distress in the Presence of Substance Use: A Differential Item Functioning Analysis of the Kessler 10 Psychological Distress Scale

Auteurs: Matthew Sunderland, Jillian Halladay, Cath Chapman

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 1/2025

Abstract

When comparing scores on psychological distress scales across people who use substances versus those who do not, it is essential that the psychometric characteristics of the measure across both groups are comparable. The current study investigated the presence of differential item functioning (DIF) in the Kessler 10 psychological distress scale (K10) among people who do and do not regularly use alcohol and other drugs. Data were from the 2019 National Drug Strategy Household Survey, a stratified, multistage random sample of Australian private households. Those aged between 18 and 79 with complete data were included in the analysis (n = 19339). A multiple indicator multiple cause (MIMIC) modelling approach was used to determine uniform and non-uniform DIF. The analysis identified indicators of tiredness, restlessness, psychomotor agitation, depression, and sadness that demonstrated significant levels of either uniform or non-uniform DIF across substance use groups. The overall impact of the identified DIF across groups was minimal. While there was minimal impact of DIF on overall K10 scores, the presence of DIF might reflect differences in the fundamental experience of psychological distress among those who use substances regularly. These differences could prove to be important when implementing universal prevention or early interventions for psychological distress.

vorige artikel Brain Network Analysis of Cognitive Reappraisal and Expression Inhibition Based on Graph Theory Analysis

volgende artikel Development and Evaluation of the Religious and Spiritual Struggles Scale-5 (RSS-5)

Alleen toegankelijk voor geautoriseerde gebruikers

Andrews, G., & Slade, T. (2001). Interpreting scores on the Kessler Psychological Distress Scale (K10). Australian and New Zealand Journal of Public Health, 25(6), 494–497. https://doi.org/10.1111/j.1467-842x.2001.tb00310.xCrossRefPubMed

Batterham, P. J., Sunderland, M., Slade, T., Calear, A. L., & Carragher, N. (2018). Assessing distress in the community: Psychometric properties and crosswalk comparison of eight measures of psychological distress. Psychological Medicine, 48(8), 1316–1324. https://doi.org/10.1017/S0033291717002835CrossRefPubMed

Benítez, I., Padilla, J. L., Montesinos, H., M. D., & Sireci, S. G. (2016). Using mixed methods to Interpret Differential Item Functioning. Applied Measurement in Education, 29(1), 1–16. https://doi.org/10.1080/08957347.2015.1102915CrossRef

Boness, C. L., & Sher, K. J. (2020). The case for cognitive interviewing in Survey Item Validation: A useful Approach for improving the Measurement and Assessment of Substance Use disorders. Journal of Studies on Alcohol and Drugs, 81(4), 401–404. https://doi.org/10.15288/jsad.2020.81.401CrossRefPubMedPubMedCentral

Booth, B. M., Curran, G., Han, X., Wright, P., Frith, S., Leukefeld, C., Falck, R., & Carlson, R. G. (2010). Longitudinal relationship between psychological distress and multiple substance use: Results from a three-year Multisite Natural-History study of rural stimulant users. Journal of Studies on Alcohol and Drugs, 71(2), 258–267.CrossRefPubMedPubMedCentral

Chan, Y. F., Dennis, M. L., & Funk, R. R. (2008). Prevalence and comorbidity of major internalizing and externalizing problems among adolescents and adults presenting to substance abuse treatment. Journal of Substance Abuse Treatment, 34(1), 14–24. https://doi.org/10.1016/j.jsat.2006.12.031CrossRefPubMed

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5CrossRef

Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). Iordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. https://doi.org/10.18637/jss.v039.i08CrossRefPubMedPubMedCentral

Edelen, M. O., Thissen, D., Teresi, J. A., Kleinman, M., & Ocepek-Welikson, K. (2006). Identification of differential item functioning using item response theory and the likelihood-based model comparison approach: Application to the Mini-Mental State Examination. Medical Care, 44(11 SUPPL. 3), S134–S142. https://doi.org/10.1097/01.mlr.0000245251.83359.8c

George, J., Kinner, S. A., Bruno, R., Degenhardt, L., & Dunn, M. (2010). Contextualising psychological distress among regular ecstasy users: The importance of sociodemographic factors and patterns of drug use. Drug and Alcohol Review, 29(3), 243–249. https://doi.org/10.1111/j.1465-3362.2009.00159.xCrossRefPubMed

Halladay, J., Slade, T., Chapman, C., Mewton, L., O’Dean, S., Visontay, R., Baillie, A., Teesson, M., & Sunderland, M. (2023). Is the association between psychological distress and risky alcohol consumption shifting over time? An age-period-cohort analysis of the Australian population. Psychiatry Research, 326, 115356. https://doi.org/10.1016/j.psychres.2023.115356CrossRefPubMed

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118CrossRef

Jones, R. N. (2019). Differential Item Functioning and its relevance to Epidemiology. Current Epidemiology Reports, 6(2), 174–183. https://doi.org/10.1007/s40471-019-00194-5CrossRefPubMedPubMedCentral

Kessler, R. C., Andrews, G., Colpe, L. J., Hiripi, E., Mroczek, D. K., Normand, S. L. T., Walters, E. E., & Zaslavsky, A. M. (2002). Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine, 32(6), 959–976. https://doi.org/10.1017/S0033291702006074CrossRefPubMed

Kingston, R. E. F., Marel, C., & Mills, K. L. (2017). A systematic review of the prevalence of comorbid mental health disorders in people presenting for substance use treatment in Australia. Drug and Alcohol Review, 36(4), 527–539. https://doi.org/10.1111/dar.12448CrossRefPubMed

Kopf, J., Zeileis, A., & Strobl, C. (2015). Anchor Selection Strategies for DIF Analysis. Educational and Psychological Measurement, 75(1), 22–56. https://doi.org/10.1177/0013164414529792CrossRefPubMed

Krueger, R. F., Hobbs, K. A., Conway, C. C., Dick, D. M., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Keyes, K. M., Latzman, R. D., Michelini, G., Patrick, C. J., Sellbom, M., Slade, T., South, S. C., Sunderland, M., Tackett, J., Waldman, I., Waszczuk, M. A., & Workgroup, H. U. (2021). Validity and utility of hierarchical taxonomy of psychopathology (HiTOP): II. Externalizing superspectrum. World Psychiatry, 20(2), 171–193. https://doi.org/10.1002/wps.20844CrossRefPubMedPubMedCentral

Levitt, E. E., Syan, S. K., Sousa, S., Costello, M. J., Rush, B., Samokhvalov, A. V., McCabe, R. E., Kelly, J., & MacKillop, J. (2021). Optimizing screening for depression, anxiety disorders, and post-traumatic stress disorder in inpatient addiction treatment: A preliminary investigation. Addictive Behaviors, 112, 106649. https://doi.org/10.1016/j.addbeh.2020.106649CrossRefPubMed

Li, X., Diviant, J. P., Stith, S. S., Brockelman, F., Keeling, K., Hall, B., & Vigil, J. M. (2022). The effects of Consuming Cannabis Flower for Treatment of Fatigue. Medical Cannabis and Cannabinoids, 5(1), 76–84. https://doi.org/10.1159/000524057CrossRefPubMedPubMedCentral

MacKillop, J., Agabio, R., Feldstein-Ewing, S., Heilig, M., Kelly, J. F., Leggio, L., Lingford-Hughes, A., Palmer, A., Parry, C., Ray, L., & Rehm, J. (2022). Hazardous drinking and alcohol use disorders. Nature Reviews Disease Primers, 8(1), 80. https://doi.org/10.1038/s41572-022-00406-1CrossRefPubMedPubMedCentral

Mansolf, M., & Reise, S. P. (2016). Exploratory bifactor analysis: The Schmid-Leiman Orthogonalization and Jennrich-Bentler Analytic rotations. Multivariate Behavioral Research, 51(5), 698–717. https://doi.org/10.1080/00273171.2016.1215898CrossRefPubMedPubMedCentral

Martin, E. L., Strickland, J. C., Schlienz, N. J., Munson, J., Jackson, H., Bonn-Miller, M. O., & Vandrey, R. (2021). Antidepressant and Anxiolytic effects of Medicinal Cannabis Use in an observational trial. Frontiers in Psychiatry, 12, 729800. https://doi.org/10.3389/fpsyt.2021.729800CrossRefPubMedPubMedCentral

Mewton, L., Slade, T., Teesson, M., Memedovic, S., & Krueger, R. F. (2014). Improving the diagnostic criteria for alcohol use disorders through survey methodology and cognitive interviewing. International Journal of Methods in Psychiatric Research, 23(3), 359–371. https://doi.org/10.1002/mpr.1448CrossRefPubMedPubMedCentral

Mewton, L., Kessler, R. C., Slade, T., Hobbs, M. J., Brownhill, L., Birrell, L., Tonks, Z., Teesson, M., Newton, N., Chapman, C., Allsop, S., Hides, L., McBride, N., & Andrews, G. (2016). The psychometric properties of the kessler psychological distress scale (K6) in a general population sample of adolescents. Psychological Assessment, 28(10), 1232–1242. https://doi.org/10.1037/pas0000239CrossRefPubMed

Montoya, A. K., & Jeon, M. (2020). MIMIC models for Uniform and Nonuniform DIF as Moderated Mediation models. Applied Psychological Measurement, 44(2), 118–136. https://doi.org/10.1177/0146621619835496CrossRefPubMed

Muthen, L. K., & Muthen, B. O. (2015). Mplus Users’ Guide. Muthen & Muthen.

Muthen, B., Kaplan, D., & Hollis, M. (1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 52, 431–462.CrossRef

NHMRC. (2020). Australian guidelines to reduce health risks from drinking alcohol. NHMRC.

Padilla, J. L., Benítez, I., & Castillo, M. (2013). Obtaining validity evidence by cognitive interviewing to interpret psychometric results. Methodology, 9(3), 113–122. https://doi.org/10.1027/1614-2241/a000073CrossRef

Quello, S. B., Brady, K. T., & Sonne, S. C. (2005). Mood disorders and Substance Use Disorder: A Complex Comorbidity. Science & Practice Perspectives, 3(1), 13–21.CrossRef

Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477CrossRefPubMedPubMedCentral

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Applying Bifactor Statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249CrossRefPubMed

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150.CrossRefPubMed

Slade, T., Grove, R., & Burgess, P. (2011). Kessler psychological distress scale: Normative data from the 2007 Australian National Survey of Mental Health and Wellbeing. Australian and New Zealand Journal of Psychiatry, 45(4), 308–316. https://doi.org/10.3109/00048674.2010.543653

Slade, T., Teesson, M., Mewton, L., Memedovic, S., & Krueger, R. F. (2013). Do young adults interpret the DSM Diagnostic Criteria for Alcohol Use disorders as intended? A cognitive interviewing study. Alcoholism: Clinical and Experimental Research, 37(6), 1001–1007. https://doi.org/10.1111/acer.12063CrossRefPubMed

Sunderland, M., Slade, T., Stewart, G., & Andrews, G. (2011). Estimating the prevalence of DSM-IV mental illness in the Australian general population using the Kessler Psychological Distress Scale. Australian and New Zealand Journal of Psychiatry, 45(10), 880–889. https://doi.org/10.3109/00048674.2011.606785CrossRefPubMed

Sunderland, M., Mahoney, A., & Andrews, G. (2012). Investigating the factor structure of the Kessler Psychological Distress Scale in community and clinical samples of the Australian population. Journal of Psychopathology and Behavioral Assessment, 34(2), 253–259. https://doi.org/10.1007/s10862-012-9276-7CrossRef

Teesson, M., Slade, T., & Mills, K. (2009). Comorbidity in Australia: Findings of the 2007 National Survey of Mental Health and Wellbeing. Australian and New Zealand Journal of Psychiatry, 43(7), 606–614. https://doi.org/10.1080/00048670902970908CrossRefPubMed

Teresi, J. A. (2006). Different approaches to differential item functioning in health applications: Advantages, disadvantages and some neglected topics. Medical Care, 44(11 SUPPL. 3), S152–S170. https://doi.org/10.1097/01.mlr.0000245142.74628.abCrossRefPubMed

Teresi, J. A., & Fleishman, J. A. (2007). Differential item functioning and health assessment. Quality of Life Research, 16(SUPPL. 1), 33–42. https://doi.org/10.1007/s11136-007-9184-6CrossRefPubMed

Teresi, J. A., Wang, C., Kleinman, M., Jones, R. N., & Weiss, D. J. (2021). Differential Item Functioning analyses of the patient-reported outcomes Measurement Information System (PROMIS^®) measures: Methods, challenges, advances, and future directions. Psychometrika 2021, 86:3(3), 674–711. https://doi.org/10.1007/S11336-021-09775-0. 86.CrossRef

Thissen, D., Steinberg, L., & Kuang, D. (2002). Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Educational and Behavioral Statistics, 27(1), 77–83. https://doi.org/10.3102/10769986027001077CrossRef

Ummels, S. A., Seldenrijk, A., Bos, E. H., de Graaf, R., Batelaan, N. M., & ten Have, M. (2022). The bidirectional relationship between anxiety disorders and alcohol use disorders in adults: Findings from a longitudinal population-based study. Journal of Affective Disorders, 314, 126–132. https://doi.org/10.1016/j.jad.2022.06.091CrossRefPubMed

Willis, G. B. (2004). Cognitive interviewing: A Tool for improving Questionnaire Design. SAGE.

Woods, C. M. (2009a). Empirical selection of anchors for tests of differential item functioning. Applied Psychological Measurement, 33(1), 42–57. https://doi.org/10.1177/0146621607314044CrossRef

Woods, C. M. (2009b). Evaluation of MIMIC-Model methods for DIF Testing with comparison to two-group analysis. Multivariate Behavioral Research, 44(1), 1–27. https://doi.org/10.1080/00273170802620121CrossRefPubMed

Woods, C. M., & Grimm, K. J. (2011). Testing for Nonuniform Differential Item Functioning with multiple Indicator multiple cause models. Applied Psychological Measurement, 35(5), 339–361. https://doi.org/10.1177/0146621611405984CrossRef

Titel: Measuring Distress in the Presence of Substance Use: A Differential Item Functioning Analysis of the Kessler 10 Psychological Distress Scale
Auteurs: Matthew Sunderland
Jillian Halladay
Cath Chapman
Publicatiedatum: 01-03-2025
Uitgeverij: Springer US
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment / Uitgave 1/2025
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI: https://doi.org/10.1007/s10862-024-10181-w

Andere artikelen Uitgave 1/2025

Behavioral Targets to Concurrently Reduce Depression and Promote Psychological Well-Being: The Roles of Self-Referential Processing Bias and State Self-Esteem

Open Access

The Relationships Between Adolescent Anxiety Sensitivity, Parent Emotional Availability, and Gender in the Context of Adolescent Anxiety

Open Access

Bohn Stafleu van Loghum

Welkom bij Scalda & Bohn Stafleu van Loghum

Registreer

Login

Measuring Distress in the Presence of Substance Use: A Differential Item Functioning Analysis of the Kessler 10 Psychological Distress Scale

Abstract

Andere artikelen Uitgave 1/2025

Behavioral Targets to Concurrently Reduce Depression and Promote Psychological Well-Being: The Roles of Self-Referential Processing Bias and State Self-Esteem

Patterns of Parent – Child Agreement on Risk for Psychopathology – the Relations with Parental Stress and Mental Health

The Role of Interpersonal Emotion Regulation Strategies Within the Perfectionism Social Disconnection Model

Reexamination of Factor Structure and Differential Correlates of the Short Almost Perfect Scale-8

Child Emotional Characteristics as Predictors of Informant Disagreement in Oppositional Defiant Symptomatology

The Relationships Between Adolescent Anxiety Sensitivity, Parent Emotional Availability, and Gender in the Context of Adolescent Anxiety

Bohn Stafleu van Loghum

Welkom bij Scalda & Bohn Stafleu van Loghum

Registreer

Login

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Behavioral Targets to Concurrently Reduce Depression and Promote Psychological Well-Being: The Roles of Self-Referential Processing Bias and State Self-Esteem

Patterns of Parent – Child Agreement on Risk for Psychopathology – the Relations with Parental Stress and Mental Health

The Role of Interpersonal Emotion Regulation Strategies Within the Perfectionism Social Disconnection Model

Reexamination of Factor Structure and Differential Correlates of the Short Almost Perfect Scale-8

Child Emotional Characteristics as Predictors of Informant Disagreement in Oppositional Defiant Symptomatology

The Relationships Between Adolescent Anxiety Sensitivity, Parent Emotional Availability, and Gender in the Context of Adolescent Anxiety