Loading...
Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers
Ahern, Tracey Gardner, Anne Gardner, Glenn Middleton, Sandy Della, Phillip
Ahern, Tracey
Gardner, Anne
Gardner, Glenn
Middleton, Sandy
Della, Phillip
Abstract
Background
The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers.
Methods
The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles.
Results
Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better.
Conclusion
The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap.
Keywords
nurse interviewers, nurse practitioner, interrater reliability, SF12, Charlson Comorbidity Index
Date
2013
Type
Journal article
Journal
Nurse Education Today
Book
Volume
33
Issue
5
Page Range
470-474
Article Number
ACU Department
Nursing Research Institute
Faculty of Health Sciences
Faculty of Health Sciences
Collections
Relation URI
Source URL
Event URL
Open Access Status
License
All rights reserved
File Access
Controlled