autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects

Journal article


Courtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B.. (2021). autopsych : An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects. PLoS ONE. 16(10), p. e0257682. https://doi.org/10.1371/journal.pone.0257682
AuthorsCourtney, Matthew G.R., Chang, Kevin C.T., Mei, Bing, Meissel, Kane, Rowe, Luke and Issayeva, Laila B.
Abstract

In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app’s architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed.

Year2021
JournalPLoS ONE
Journal citation16 (10), p. e0257682
PublisherPublic Library of Science
ISSN1932-6203
Digital Object Identifier (DOI)https://doi.org/10.1371/journal.pone.0257682
PubMed ID34634792
Scopus EID2-s2.0-85116905527
PubMed Central IDPMC8505029
Open accessPublished as ‘gold’ (paid) open access
Research or scholarlyResearch
Page range1-24
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online11 Oct 2021
Publication process dates
Accepted07 Sep 2021
Deposited06 Jan 2022
Permalink -

https://acuresearchbank.acu.edu.au/item/8x40z/autopsych-an-r-shiny-tool-for-the-reproducible-rasch-analysis-differential-item-functioning-equating-and-examination-of-group-effects

Download files


Publisher's version
OA_Courtney_2021_Autopsych_an_r_shiny_tool_for.pdf
License: CC BY 4.0
File access level: Open

  • 95
    total views
  • 43
    total downloads
  • 2
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Coding and computational thinking across the curriculum : A review of educational outcomes
Mills, Kathy Ann, Cope, Jen, Scholes, Laura and Rowe, Luke. (2024). Coding and computational thinking across the curriculum : A review of educational outcomes. Review of Educational Research. pp. 1-38. https://doi.org/10.3102/00346543241241327
Research Through the Eyes of Teachers
Rowe, Luke and Hattie, John. (2023). Research Through the Eyes of Teachers. In In Their Own Words: What Scholars and Teachers WantYou to Know About Why and Howto Apply the Science of Learning inYour Academic Setting pp. 44-60 Society for the Teaching of Psychology.
Validating a forced‑choice method for eliciting quality‑of‑reasoning judgments
Marcoci, Alexandru, Stelmach, Margaret E., Rowe, Luke, Barnett, Ashley, Primoratz, Tamar, Kruger, Ariel, Karvetski, Christopher W., Stone, Benjamin, Diamond, Michael L., Saletta, Morgan, van Gelder, Tim, Tetlock, Philip E. and Dennis, Simon. (2023). Validating a forced‑choice method for eliciting quality‑of‑reasoning judgments. Behavior Research Methods. pp. 1-16. https://doi.org/10.3758/s13428-023-02234-x
What do secondary teachers think about digital games for learning : Stupid fixation or the future of education?
Gutierrez, Amanda, Mills, Kathy, Scholes, Laura, Rowe, Luke and Pink, Elizabeth. (2023). What do secondary teachers think about digital games for learning : Stupid fixation or the future of education? Teaching and Teacher Education. 133, p. Article 104278. https://doi.org/10.1016/j.tate.2023.104278
Spiritual and Pedagogical Accompaniment (SPA) program 2022
Gutierrez, Amanda and Rowe, Luke. (2023). Spiritual and Pedagogical Accompaniment (SPA) program 2022 Brisbane, Queensland: Australian Catholic University.
Spiritual and Pedagogical Accompaniment (SPA) program (2019-2021)
Gutierrez, Amanda and Rowe, Luke. (2022). Spiritual and Pedagogical Accompaniment (SPA) program (2019-2021) Brisbane, Queensland: Australian Catholic University.
Video gaming and digital competence among elementary school students
Scholes, Laura, Rowe, Luke, Mills, Kathy A., Gutierrez, Amanda and Pink, Elizabeth. (2022). Video gaming and digital competence among elementary school students. Learning, Media and Technology. pp. 1-16. https://doi.org/10.1080/17439884.2022.2156537
g versus c : comparing individual and collective intelligence across two meta-analyses
Rowe, Luke I., Hattie, John and Hester, Robert. (2021). g versus c : comparing individual and collective intelligence across two meta-analyses. Cognitive Research: Principles and Implications. 6(1), p. Article 26. https://doi.org/10.1186/s41235-021-00285-2
Metacognition and self‑regulated learning
Rowe, Luke and Kang, Sean. (2019). Metacognition and self‑regulated learning Australia: Evidence for Learning.
Open dialogue peer review : A response to Claxton & Lucas
Hattie, John, Clinton, Janet and Rowe, Luke. (2016). Open dialogue peer review : A response to Claxton & Lucas. Psychology of Education Review. 40(1), pp. 30-37. https://doi.org/10.53841/bpsper.2016.40.1.30