The application of pairwise comparisons to form scaled exemplars as a basis for setting and exemplifying standards in teacher education
Journal article
Wyatt-Smith, Claire, Humphrey, Stephen, Adie, Lenore and Colbert, Peta. (2020). The application of pairwise comparisons to form scaled exemplars as a basis for setting and exemplifying standards in teacher education. Assessment in Education. 27(1), pp. 65-86. https://doi.org/10.1080/0969594X.2020.1712326
Authors | Wyatt-Smith, Claire, Humphrey, Stephen, Adie, Lenore and Colbert, Peta |
---|---|
Abstract | This paper details a two-stage process for standard setting using an extended pairwise comparison method. It describes the application of a new process of establishing a set of scaled and ordered performances as a basis for exemplifying standards. In stage one, the method of pairwise comparison was used to generate data from pairwise judgements made at the criterion level and overall grade. In stage two, judges identified where the pass/fail boundary lay in relation to a selected subset of ordered performances generated from stage one. The combined evidence from the two-stage process demonstrates the method’s application to establish exemplified standards using on-balance judgements across multiple criteria. The approach combines expert judgement and statistical data to provide a basis for comparable cross-institution assessments against standards in the case of a summative assessment of professional competence in teacher education. It may be relevant to any discipline with professional standards and complex performance assessments. |
Keywords | performance assessment; professional judgement; standard setting; pairwise comparison; comparative judgement; initial teacher education; teacher performance assessment |
Year | 2020 |
Journal | Assessment in Education |
Journal citation | 27 (1), pp. 65-86 |
Publisher | Routledge |
ISSN | 0969-594X |
Digital Object Identifier (DOI) | https://doi.org/10.1080/0969594X.2020.1712326 |
Scopus EID | 2-s2.0-85077900074 |
Research or scholarly | Research |
Page range | 65-86 |
Funder | Australian Catholic University (ACU) |
Publisher's version | License All rights reserved File Access Level Controlled |
Output status | Published |
Publication dates | |
Online | 13 Jan 2020 |
Publication process dates | |
Accepted | 20 Dec 2019 |
Deposited | 16 Dec 2021 |
https://acuresearchbank.acu.edu.au/item/8x343/the-application-of-pairwise-comparisons-to-form-scaled-exemplars-as-a-basis-for-setting-and-exemplifying-standards-in-teacher-education
Restricted files
Publisher's version
117
total views0
total downloads1
views this month0
downloads this month