The assessment of physiotherapy practice is a robust measure of entry-level physiotherapy standards : Reliability and validity evidence from a large, representative sample

Journal article


Reubenson, Alan, Ng, Leo, Lawton, Vidya, Nahon, Irmina, Terry, Rebecca, Baldwin, Claire, Blackford, Julia, Bond, Alex, Corrigan, Rosemary, Dalton, Megan, Dario, Amabile Borges, Donovan, Michael, Dunwoodie, Ruth, Dwyer, Genevieve M., Forbes, Roma, Francis-Cracknell, Alison, Gill, Janelle, Hams, Andrea, Jones, Anne, ... Gucciardi, Daniel F.. (2025). The assessment of physiotherapy practice is a robust measure of entry-level physiotherapy standards : Reliability and validity evidence from a large, representative sample. PLoS ONE. 20(4), p. Article e0321397. https://doi.org/10.1371/journal.pone.0321397
AuthorsReubenson, Alan, Ng, Leo, Lawton, Vidya, Nahon, Irmina, Terry, Rebecca, Baldwin, Claire, Blackford, Julia, Bond, Alex, Corrigan, Rosemary, Dalton, Megan, Dario, Amabile Borges, Donovan, Michael, Dunwoodie, Ruth, Dwyer, Genevieve M., Forbes, Roma, Francis-Cracknell, Alison, Gill, Janelle, Hams, Andrea, Jones, Anne, Jones, Taryn, Judd, Belinda, Kennedy, Ewan, Morgan, Prue, Palmer, Tanya, Peiris, Casey, Taylor, Carolyn, Virtue, Debra, Zischke, Cherie and Gucciardi, Daniel F.
Abstract

The Assessment of Physiotherapy Practice (APP) is a 20-item assessment instrument used to assess entry-level physiotherapy practice in Australia, New Zealand and other international locations. Initial APP reliability and validity evidence supported a unidimensional or single latent factor as the best representation of entry-level physiotherapy practice performance. However, there remains inconsistency in how the APP is interpreted and operationalised across Australian and New Zealand universities offering entry-level physiotherapy programs. In essence, the presumption that the psychometric integrity of the APP generalises across people, time, and contexts remains largely untested. This multi-site, archival replication study utilised APP assessment data from 8,979 clinical placement assessments, across 19 Australian and New Zealand universities, graduating entry-level physiotherapy students (n=1865) in 2019. Structural representation of APP scores were examined via confirmatory factor analysis and penalised structural equation models. Factor analyses indicated a 2-factor representation, with four items (1–4) for the professional dimension and 16 items (5–20) for the clinical dimension, is the best approximation of entry-level physiotherapy performance. Measurement invariance analyses supported the robustness of this 2-factor representation over time and across diverse practice areas in both penultimate and final years of study. The findings provide strong evidence for the psychometric integrity of the APP, and the 2-factor alternative interpretation and operationalisation is recommended. To meet entry-level standards students should be assessed as competent across both professional and clinical dimensions of physiotherapy practice.

Year2025
JournalPLoS ONE
Journal citation20 (4), p. Article e0321397
PublisherPublic Library of Science
ISSN1932-6203
Digital Object Identifier (DOI)https://doi.org/10.1371/journal.pone.0321397
PubMed ID40249749
Scopus EID2-s2.0-105003035818
PubMed Central IDPMC12007712
Open accessPublished as ‘gold’ (paid) open access
Page range1-18
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online18 Apr 2025
Publication process dates
Accepted05 Mar 2025
Deposited11 Jun 2025
Additional information

© 2025 Reubenson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Permalink -

https://acuresearchbank.acu.edu.au/item/91yx3/the-assessment-of-physiotherapy-practice-is-a-robust-measure-of-entry-level-physiotherapy-standards-reliability-and-validity-evidence-from-a-large-representative-sample

Download files


Publisher's version
  • 2
    total views
  • 2
    total downloads
  • 2
    views this month
  • 2
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Rating of physiotherapy student clinical performance in a paediatric setting : Are assessors consistent in their rating of a simulated clinical student performance?
Fulton, Tessa, Myatt, Kerry, Kirwan, Garry W., Clark, Courtney R. and Dalton, Megan. (2023). Rating of physiotherapy student clinical performance in a paediatric setting : Are assessors consistent in their rating of a simulated clinical student performance? BMC Medical Education. 23(1), p. Article 280. https://doi.org/10.1186/s12909-023-04149-9
Fostering patient uptake of recommended health services and self-management strategies for musculoskeletal conditions : A Delphi study of clinician attributes
O'Leary, Shaun, Gale, Janette, Volker, Glen, Kuipers, Pim, Dalton, Megan and McPhail, Steven. (2020). Fostering patient uptake of recommended health services and self-management strategies for musculoskeletal conditions : A Delphi study of clinician attributes. Musculoskeletal Care. 18(2), pp. 161-168. https://doi.org/10.1002/msc.1448
Acceptance of the 'Assessment of Physiotherapy Practice (Chinese)' as a standardised evaluation of professional competency in Chinese physiotherapy students : An observational study
Jia Hu, Jones, Alice Y. M., Zhou, Xuelian, Zhai, Hua, Ngai, Shirley P. C., Siu, Ka-Chun and Dalton, Megan. (2020). Acceptance of the 'Assessment of Physiotherapy Practice (Chinese)' as a standardised evaluation of professional competency in Chinese physiotherapy students : An observational study. BMC Medical Education. 20(1), p. 108. https://doi.org/10.1186/s12909-020-02026-3
Physiotherapy students' DiSC behaviour styles can be used to predict the likelihood of success in clinical placements
Milne, Nikki, Louwen, Chanelle, Reidlinger, Dianne, Bishop, Jo, Dalton, Megan and Crane, Linda. (2019). Physiotherapy students' DiSC behaviour styles can be used to predict the likelihood of success in clinical placements. BMC Medical Education. 19(1), p. 19. https://doi.org/10.1186/s12909-019-1825-2
Rating of physiotherapy student clinical performance : Is it possible to gain assessor consistency?
Kirwan, Garry W., Clark, Courtney R. and Dalton, Megan. (2019). Rating of physiotherapy student clinical performance : Is it possible to gain assessor consistency? BMC Medical Education. 19, p. 32.
Simulation-based education improves student self-efficacy in physiotherapy assessment and management of paediatric patients
Hough, Judith, Levan, Daniel Anthony, Steele, Michael, Kelly, Kristine and Dalton, Megan. (2019). Simulation-based education improves student self-efficacy in physiotherapy assessment and management of paediatric patients. BMC Medical Education. 19(1), pp. 1 - 11. https://doi.org/10.1186/s12909-019-1894-2
Using interprofessional learning for continuing education : development and evaluation of the graduate certificate program in health professional education for clinicians
Henderson, Saras, Dalton, Megan and Cartmel, Jennifer. (2016). Using interprofessional learning for continuing education : development and evaluation of the graduate certificate program in health professional education for clinicians. Journal of Continuing Education in the Health Professions. 36(3), pp. 211-217. https://doi.org/10.1097/CEH.0000000000000093
Measuring safety climate in acute hospitals : Rasch analysis of the safety attitudes questionnaire
Soh, Sze E., Barker, Anna, Morello, Renata T., Dalton, Megan and Brand, Caroline. (2016). Measuring safety climate in acute hospitals : Rasch analysis of the safety attitudes questionnaire. BMC Health Services Research. 16(1), pp. 1 - 9. https://doi.org/10.1186/s12913-016-1744-4
Identifying educator behaviours for high quality verbal feedback in health professions education: Literature review and expert refinement
Johnson, Christina E., Keating, Jennifer L., Boud, David J., Dalton, Megan, Kiegaldie, Debra, Hay, Margaret, McGrath, Barry, McKenzie, Wendy A., Nair, Kichu Balakrishnan R., Nestel, Debra, Palermo, Claire and Molloy, Elizabeth K.. (2016). Identifying educator behaviours for high quality verbal feedback in health professions education: Literature review and expert refinement. BMC Medical Education. 16(96), pp. 1 - 11. https://doi.org/10.1186/s12909-016-0613-5
Identifying educator behaviours for high quality verbal feedback in health professions education: Literature review and expert refinement
Johnson, Christina E., Keating, Jennifer L., Boud, David, Dalton, Megan, Kiegaldie, Debra, Hay, Margaret, McGrath, Barry, McKenzie, Wendy A., Nair, Kichu Balakrishnan R., Nestel, Debra, Palermo, Claire and Molloy, Elizabeth K.. (2016). Identifying educator behaviours for high quality verbal feedback in health professions education: Literature review and expert refinement. BMC Medical Education. 16(1), pp. 1 - 11. https://doi.org/10.1186/s12909-016-0613-5
Validation of the Australian Nursing Standards Assessment Tool (ANSAT): A pilot study
Ossenberg, Christine, Dalton, Megan and Henderson, Amanda. (2016). Validation of the Australian Nursing Standards Assessment Tool (ANSAT): A pilot study. Nurse Education Today. 36, pp. 23 - 30. https://doi.org/10.1016/j.nedt.2015.07.012
Rating of physiotherapy student clinical performance: Is it possible to gain assessor consistency?
Clark, C., Kirwan, G. M. and Dalton, Megan Bernadette. (2016). Rating of physiotherapy student clinical performance: Is it possible to gain assessor consistency? The 4th European Congress of the ER-WCPT. United Kingdom: Elsevier. pp. eS33 - eS34
Determining attainment of nursing standards: The use of behavioural cues to enhance clarity and transparency in student clinical assessment
Ossenberg, Christine, Henderson, Amanda and Dalton, Megan Bernadette. (2015). Determining attainment of nursing standards: The use of behavioural cues to enhance clarity and transparency in student clinical assessment. Nurse Education Today. 35(1), pp. 12 - 15. https://doi.org/10.1016/j.nedt.2014.09.002
www.applinkup.com - An online system to manage and collate workplace based assessment outcomes for physiotherapy students
Dalton, Megan, Russell, T. and Keating, Jennifer L.. (2015). www.applinkup.com - An online system to manage and collate workplace based assessment outcomes for physiotherapy students. 17th World Confederation for Physical Therapy Congress. Singapore: Elsevier. pp. S288 - S289
Consensus between assessors regarding ratings of competency of physiotherapy students: Is it possible?
Clark, C., Kirwan, G. M. and Dalton, Megan Bernadette. (2015). Consensus between assessors regarding ratings of competency of physiotherapy students: Is it possible? APA National Conference. Australia: Elsevier. pp. S254 - S255 https://doi.org/10.1016/j.physio.2015.03.437
Assessing physical therapy students' performance during clinical practice
Murphy, Sue, Dalton, Megan and Dawes, Diana. (2014). Assessing physical therapy students' performance during clinical practice. Physiotherapy Canada. 66(2), pp. 169 - 176. https://doi.org/10.3138/ptc.2013-26
Assessing physical therapy students' performance during clinical practice
Murphy, Sue, Dalton, Megan and Dawes, Diana. (2014). Assessing physical therapy students' performance during clinical practice. Physiotherapy Canada. 66(2), pp. 169 - 176. https://doi.org/10.3138/ptc.2013-26
The Assessment of Physiotherapy Practice (APP) is a reliable measure of professional competence of physiotherapy students: A reliability study
Dalton, Megan, Davidson, Megan and Keating, Jennifer L.. (2012). The Assessment of Physiotherapy Practice (APP) is a reliable measure of professional competence of physiotherapy students: A reliability study. Journal of Physiotherapy. 58(1), pp. 49 - 56. https://doi.org/10.1016/S1836-9553(12)70072-3
Building sustainable capacity in physiotherapy clinical education: An innovative Queensland state-wide collaboration
Dunwoodie, R., Moller, M., Teys, P., Blackwell, L., Dalton, Megan Bernadette, Kirwan, G. M., Offord, Sonia S., Pellatt, A. and Stuart, R.. (2011). Building sustainable capacity in physiotherapy clinical education: An innovative Queensland state-wide collaboration. World Physical Therapy 2011. Amsterdam: Elsevier. pp. eS1474 - eS1475
A systematic review of instruments for the assessment of professional competence of physiotherapy students
Dalton, Megan, Davidson, Megan and Keating, Jennifer L.. (2011). A systematic review of instruments for the assessment of professional competence of physiotherapy students. World Physical Therapy 2011. Amsterdam: Elsevier. pp. eS256 - eS257
The Assessment of Physiotherapy Practice (APP) is a valid measure of professional competence of physiotherapy students: A cross-sectional study with Rasch analysis
Dalton, Megan, Davidson, Megan and Keating, Jennifer L.. (2011). The Assessment of Physiotherapy Practice (APP) is a valid measure of professional competence of physiotherapy students: A cross-sectional study with Rasch analysis. Journal of Physiotherapy. 57(4), pp. 239 - 245. https://doi.org/10.1016/S1836-9553(11)70054-6
Promoting and providing expert guidance in work-intensive clinical settings
Henderson, Amanda, Alexander, Heather, Haywood, Alison, Stapleton, Peta, Cooke, Marie, Patterson, Elizabeth, Dalton, Megan and Creedy, Debra K.. (2010). Promoting and providing expert guidance in work-intensive clinical settings. Vocations and Learning. 3(2), pp. 141 - 156. https://doi.org/10.1007/s12186-010-9036-3
The objective structured clinical examination (OSCE): Optimising its value in the undergraduate nursing curriculum
Mitchell, Marion L., Henderson, Amanda, Dalton, Megan, Groves, Michele and Nulty, Duncan. (2009). The objective structured clinical examination (OSCE): Optimising its value in the undergraduate nursing curriculum. Nurse Education Today. 29(4), pp. 398 - 404. https://doi.org/10.1016/j.nedt.2008.10.007
Boosting morale and improving performance in the nursing setting
Stapleton, Peta, Henderson, Amanda, Creedy, Debra K., Cooke, Marie, Patterson, Elizabeth, Alexander, Heather, Haywood, Alison and Dalton, Megan. (2007). Boosting morale and improving performance in the nursing setting. Journal of Nursing Management. 15(8), pp. 811 - 816. https://doi.org/10.1111/j.1365-2934.2007.00745.x