The role of evaluation methods in health-related e-learning : A rapid review

Journal article

Stemp, Jason D., Ghosh, Debannita, Khan, Urooj R. and Boyd, James H.. (2022). The role of evaluation methods in health-related e-learning : A rapid review. Online Learning Journal. 26(4), pp. 369-398.
AuthorsStemp, Jason D., Ghosh, Debannita, Khan, Urooj R. and Boyd, James H.

Training and development programs are increasingly delivered online with numerous studies reporting no differences in learning outcomes between online and traditional learning. However, there are no established standardized methods to evaluate the effectiveness of online learning. This review aims to map the state of research around health-related education to determine what e-learning evaluation methods are being used, the strengths or deficiencies of these methods, and which are appropriate for measuring the effectiveness of online education. Databases searched were PubMed, ProQuest, Education Resources Information Centre, Cumulative Index to Nursing and Allied Health Literature, Scopus, PsychInfo, and Medline. Studies were included if they were published between 2011 and 2021, reported health-related online education and included an evaluation component. Thirty studies were obtained from numerous countries with varied methodologies and designs. Participants ranged from undergraduate students to medical professionals. Evaluation methods included student participation, students’ reaction to the training program, self-efficacy, knowledge assessment, long-term performance, and the Kirkpatrick Evaluation Framework. The review identified that course evaluations, such as measuring student satisfaction scores alone, are insufficient when used to quantify learning effectiveness for online education. This was particularly important as studies are reporting these single metrics as positive effects of training interventions without justification. Suggestions within the reviewed papers were to adopt and implement an appropriate validated method within the course curriculum to evaluate learning outcomes.

Keywordsassessment tools; evaluation method; learning impact measure; outcome measure; e-learning; online education; online learning; health education; healthcare
JournalOnline Learning Journal
Journal citation26 (4), pp. 369-398
PublisherOnline Learning Consortium
Digital Object Identifier (DOI)
Scopus EID2-s2.0-85143308790
Open accessOpen access
Page range369-398
FunderDigital Health CRC
Publisher's version
File Access Level
Output statusPublished
Publication dates
Online01 Dec 2022
Publication process dates
Deposited13 Sep 2023
Permalink -

Download files

Publisher's version
License: CC BY 4.0
File access level: Open

  • 20
    total views
  • 18
    total downloads
  • 7
    views this month
  • 7
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as