Assessment of differential statement functioning in ipsative tests with multidimensional forced-choice items
Journal article
Qiu, Xue-Lan and Wang, Wen-Chung. (2021). Assessment of differential statement functioning in ipsative tests with multidimensional forced-choice items. Applied Psychological Measurement. 45(2), pp. 79-94. https://doi.org/10.1177/0146621620965739
Authors | Qiu, Xue-Lan and Wang, Wen-Chung |
---|---|
Abstract | Ipsative tests with multidimensional forced-choice (MFC) items have been widely used to assess career interest, values, and personality to prevent response biases. Recently, there has been a surge of interest in developing item response theory models for MFC items. In reality, a statement in an MFC item may have different utilities for different groups, which is referred to as differential statement functioning (DSF). However, few studies have been investigated methods for detecting DSF owing to the challenges related to the features of ipsative tests. In this study, three methods were adapted for DSF assessment in MFC items: equal-mean-utility (EMU), all-other-statement (AOS), and constant-statement (CS). Simulation studies were conducted to evaluate the recovery of parameters and the performance of the proposed methods. Results showed that statement parameters and DSF parameters were well recovered for all the three methods when the test did not contain any DSF statement. When the test contained one or more DSF statements, only the CS method yielded accurate estimates. With respect to DSF assessment, both the EMU method using the bootstrap standard error and the AOS method performed appropriately so long as the test did not contain any DSF statement. The CS method performed well in cases where one or more DSF-free statements were chosen as an anchor. The longer the anchor statements, the higher the power of DSF detection. |
Keywords | differential item functioning; ipsative tests; multidimensional forced-choice; item response theory |
Year | 2021 |
Journal | Applied Psychological Measurement |
Journal citation | 45 (2), pp. 79-94 |
Publisher | SAGE Publications |
ISSN | 0146-6216 |
Digital Object Identifier (DOI) | https://doi.org/10.1177/0146621620965739 |
PubMed ID | 33627915 |
Scopus EID | 2-s2.0-85093832836 |
PubMed Central ID | PMC7876635 |
Page range | 79-94 |
Funder | The University of Hong Kong |
Research Grants Council of the Hong Kong Special Administrative Region, China | |
Publisher's version | License All rights reserved File Access Level Controlled |
Output status | Published |
Publication dates | |
Online | 21 Oct 2020 |
Publication process dates | |
Deposited | 30 Nov 2023 |
Grant ID | 845013 |
https://acuresearchbank.acu.edu.au/item/90033/assessment-of-differential-statement-functioning-in-ipsative-tests-with-multidimensional-forced-choice-items
Restricted files
Publisher's version
34
total views0
total downloads8
views this month0
downloads this month