autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects
Journal article
Courtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B.. (2021). autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects. PLoS ONE. 16(10), p. e0257682. https://doi.org/10.1371/journal.pone.0257682
Authors | Courtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B. |
---|---|
Abstract | In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app’s architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed. |
Year | 2021 |
Journal | PLoS ONE |
Journal citation | 16 (10), p. e0257682 |
Publisher | Public Library of Science |
ISSN | 1932-6203 |
Digital Object Identifier (DOI) | https://doi.org/10.1371/journal.pone.0257682 |
PubMed ID | 34634792 |
Scopus EID | 2-s2.0-85116905527 |
PubMed Central ID | PMC8505029 |
Open access | Published as ‘gold’ (paid) open access |
Research or scholarly | Research |
Page range | 1-24 |
Publisher's version | License File Access Level Open |
Output status | Published |
Publication dates | |
Online | 11 Oct 2021 |
Publication process dates | |
Accepted | 07 Sep 2021 |
Deposited | 06 Jan 2022 |
https://acuresearchbank.acu.edu.au/item/8x40z/autopsych-an-r-shiny-tool-for-the-reproducible-rasch-analysis-differential-item-functioning-equating-and-examination-of-group-effects
Download files
Publisher's version
OA_Courtney_2021_Autopsych_an_r_shiny_tool_for.pdf | |
License: CC BY 4.0 | |
File access level: Open |
95
total views43
total downloads2
views this month0
downloads this month