Next Article in Journal
A Simulation and Empirical Study of Differential Test Functioning (DTF)
Next Article in Special Issue
Approximate Invariance Testing in Diagnostic Classification Models in the Presence of Attribute Hierarchies: A Bayesian Network Approach
Previous Article in Journal
Understanding Embodied Effects of Posture: A Qualitative Study
Previous Article in Special Issue
SAS PROC IRT and the R mirt Package: A Comparison of Model Parameter Estimation for Multidimensional IRT Models
 
 
Psych concluded publication with Volume 6, Issue 1. It has been succeeded by Psychology International, which has a revised scope and a new editorial direction and is now published here. To preserve historical data integrity, the information on this webpage is retained but will no longer be updated.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Detecting Differential Item Functioning in 2PL Multistage Assessments

1
Department for Psychology, University of Zurich, 8050 Zurich, Switzerland
2
School of Psychology and Psychotherapy, Witten/Herdecke University, 58448 Witten, Germany
3
Faculty of Psychology and Educational Sciences, Ghent University, 9000 Gent, Belgium
4
Department of Psychology and Psychotherapy, Witten/Herdecke University, 58448 Witten, Germany
*
Author to whom correspondence should be addressed.
Psych 2023, 5(2), 461-477; https://doi.org/10.3390/psych5020031
Submission received: 29 March 2023 / Revised: 26 May 2023 / Accepted: 29 May 2023 / Published: 31 May 2023
(This article belongs to the Special Issue Computational Aspects and Software in Psychometrics II)

Abstract

The detection of differential item functioning is crucial for the psychometric evaluation of multistage tests. This paper discusses five approaches presented in the literature: logistic regression, SIBTEST, analytical score-based tests, bootstrap score-based tests, and permutation score-based tests. First, using an simulation study inspired by a real-life large-scale educational assessment, we compare the five approaches with respect to their type I error rate and their statistical power. Then, we present an application to an empirical data set. We find that all approaches show type I error rates close to the nominal alpha level. Furthermore, all approaches are shown to be sensitive to uniform and non-uniform DIF effects, with the score-based tests showing the highest power.
Keywords: item response theory; differential item functioning; multistage testing item response theory; differential item functioning; multistage testing

Share and Cite

MDPI and ACS Style

Debelak, R.; Appelbaum, S.; Debeer, D.; Tomasik, M.J. Detecting Differential Item Functioning in 2PL Multistage Assessments. Psych 2023, 5, 461-477. https://doi.org/10.3390/psych5020031

AMA Style

Debelak R, Appelbaum S, Debeer D, Tomasik MJ. Detecting Differential Item Functioning in 2PL Multistage Assessments. Psych. 2023; 5(2):461-477. https://doi.org/10.3390/psych5020031

Chicago/Turabian Style

Debelak, Rudolf, Sebastian Appelbaum, Dries Debeer, and Martin J. Tomasik. 2023. "Detecting Differential Item Functioning in 2PL Multistage Assessments" Psych 5, no. 2: 461-477. https://doi.org/10.3390/psych5020031

APA Style

Debelak, R., Appelbaum, S., Debeer, D., & Tomasik, M. J. (2023). Detecting Differential Item Functioning in 2PL Multistage Assessments. Psych, 5(2), 461-477. https://doi.org/10.3390/psych5020031

Article Metrics

Back to TopTop