autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects

Journal article


Courtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B.. (2021). autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects. PLoS ONE. 16(10), p. e0257682. https://doi.org/10.1371/journal.pone.0257682
AuthorsCourtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B.
Abstract

In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app’s architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed.

Year2021
JournalPLoS ONE
Journal citation16 (10), p. e0257682
PublisherPublic Library of Science
ISSN1932-6203
Digital Object Identifier (DOI)https://doi.org/10.1371/journal.pone.0257682
PubMed ID34634792
Scopus EID2-s2.0-85116905527
PubMed Central IDPMC8505029
Open accessPublished as ‘gold’ (paid) open access
Research or scholarlyResearch
Page range1-24
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online11 Oct 2021
Publication process dates
Accepted07 Sep 2021
Deposited06 Jan 2022
Permalink -

https://acuresearchbank.acu.edu.au/item/8x40z/autopsych-an-r-shiny-tool-for-the-reproducible-rasch-analysis-differential-item-functioning-equating-and-examination-of-group-effects

Download files


Publisher's version
OA_Courtney_2021_Autopsych_an_r_shiny_tool_for.pdf
License: CC BY 4.0
File access level: Open

  • 2
    total views
  • 1
    total downloads
  • 2
    views this month
  • 1
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

g versus c : comparing individual and collective intelligence across two meta-analyses
Rowe, Luke I., Hattie, John and Hester, Robert. (2021). g versus c : comparing individual and collective intelligence across two meta-analyses. Cognitive Research: Principles and Implications. 6(1), p. Article 26. https://doi.org/10.1186/s41235-021-00285-2