Mary Hennekes*, BS1; Sarah Rahman*, BA1; Andrea Schlosser, BBA1; Anne Drake, BA1; Tessa Nelson, BS1; Emily Hoffberg, BS1; Robert A. Jones, DO, FACEP1,2
*Contributed equally to the manuscript
(1) Case Western Reserve University School of Medicine, Cleveland, OH
(2) The MetroHealth System Department of Emergency Medicine, Cleveland, OH
Download supplementary material: Supplemental Information
Introduction: Gamification engages learners and has successfully taught point-of-care ultrasound (POCUS) to residents and fellows. Yet ultrasound (US) curricula in undergraduate medical education remains limited. This study assessed a gamification model integrating US, anatomy, physiology, physical examination, and radiology created for preclinical medical students as compared with traditional didactic education. Methods: Twenty first-year medical students participated in a session on neck and thyroid material. Students were randomly assigned to a game or non-game group. Game students participated in games incorporating thyroid US with exam maneuvers, other imaging modalities, physiology, and pathology. Non-game students were taught the same material with an instructor. Students were assessed with a pretest and immediate and delayed post-tests. Group differences and scores were assessed using t-tests. A Likert scale evaluated learners’ opinions of the educational experience. Results: The game group performed better than the non-game group on the immediate post-test (p = 0.007, CI = [0.0305, ∞]). There was no significant difference between the groups on the delayed post-test (p = 0.726, CI = [-0.120, ∞]). Students in both groups felt more confident in their knowledge of the material, and all students in the game group agreed that the games encouraged teamwork. Most (9/10) stated the games allowed them to learn the material more effectively and would like to see more gamification (8/10). Conclusion: This US education model incorporating gamification for preclinical medical students promotes teamwork and is as effective for learning material than a traditional learning model. Students additionally convey a positive attitude towards gamification.
In recent years, point of care ultrasound (POCUS) has been increasingly incorporated into the bedside evaluation of patients by many different medical specialties. POCUS does not replace formal ultrasound (US) studies, but it can quickly provide information that may be life-saving for patients . Previous studies have demonstrated that intensivists and residents alike can be taught focused cardiac echocardiography with findings that consistently agree with those of experienced echocardiographers [2,3]. As POCUS increases in value as a safe and evidence-based tool, medical schools have begun to incorporate US into the physical examination, anatomy, and physiology curricula. Requirements for US education have been established at the graduate level, but integration of US into undergraduate medical education in the United States has varied across institutions . Some have successfully piloted US training as early as the preclinical years of medical education [5,6], highlighting the applicability of US to physical examination and anatomy skills. Medical student response to US teaching has been enthusiastic with active student engagement [7,8], and students express interest in pursuing US education [9,10].
Gamification, defined as an approach to teaching and learning where educators design more motivational learning experiences by using methods from game design in non-game contexts [11,12], is an innovative method of instruction that increases learner engagement and aims to affect behaviors and learner attitudes. In a meta-analysis by Sailer and Homner, they reviewed the effect that gamification has had on different types of learning outcomes including cognitive, motivational, and behavioral learning as compared with conventional instructional methods and found a small but significant positive effect of gamification on each of these learning outcomes . They also found that when a component of social interaction was included, motivational and behavioral learning outcomes can be positively influenced by creating an environment of competition and collaboration. Within medical education, gamification has been successfully used to teach POCUS to residents and fellows, demonstrating an increase in short-term learning and overall satisfaction [14,15]; however, gamification itself remains an emerging and controversial area of education . Furthermore, when US education utilizing gamification is offered at events such as Ultrafest , students in all years of medical school are often required to complete the same games, although they have various levels of knowledge and clinical experience.
Additionally, some medical schools have started to incorporate various diagnostic modalities with the physical exam and physiology during the preclinical years [18,19]. US, in conjunction with other diagnostic studies and concepts drawn from physiology, can be used to reinforce students’ anatomical knowledge and hone diagnostic skills [5,20]. This study was designed to create a method of education that caters to the knowledge base of preclinical students (first- and second-year medical students) and utilizes game design taken from POCUS education as a vector. This study sought to determine the role of gamification in preclinical education and integration of clinical US, anatomy, physiology, physical examination, and radiology, to compare gamification with traditional education through both short- and long-term recall of material, and to promote self-guided education and teamwork.
Twenty first-year medical students participated in a two-hour interactive session where they learned neck anatomy and radiology, reviewed thyroid physiology and pathology, and practiced physical exam maneuvers involving the neck as an adjunct to material already discussed in the medical school curriculum in the preceding weeks. All students were novices in POCUS having had less than 30 hours of prior US experience. Students were randomly assigned to a game or non-game group, and all students completed a pretest to gather demographic data, assess prior knowledge about neck and thyroid concepts, and determine if there were any group differences. This study was approved by the university’s Institutional Review Board.
Both groups were taught US basics – anatomical directions, probe selection, and image optimization – through a short instructional video created by study investigators. Students randomized to the game group were then split into teams to complete 3 game stations. At each station, they watched a video created by study investigators relating to the station topic and participated in a self-guided game with time for topic review with a senior medical student following game completion. Students randomized to the non-game group were also split into 3 groups and watched the same videos but were taught the station material through a traditional lecture format. Instructors were senior medical students or residents with significant prior US experience. They were provided with an instructor manual and advised to not deviate from the script in order to standardize the learner experience. The same educational objectives were used for both the game and non-game stations.
The first game station was called “Ball Toss”. Ten plastic cups were arranged in a pyramid shape. Each cup corresponded to a numbered question about thyroid physiology, clinical vignettes, or sonographic images for identification of structures. Each team member took turns attempting to throw a ball from a specified distance into the cups. When they landed a ball in a cup, they received the question assigned to that cup. Team members then worked together to provide a correct answer to the question.
The second game station was an image “taboo” game in which students identified structures in the neck such as the thyroid gland, sternocleidomastoid muscle, and internal jugular vein in CT and MRI images as well as hands-on US scans. One student was asked to describe the structure without using any of the listed “taboo” words while the remaining team members named the correct structure and identified the structure on the image or using a handheld US device. For example, to identify the internal jugular vein on ultrasound, students could not use the words “carotid”, “jugular”, “vessel”, “MRI”, “X-Ray”, “ultrasound”, or “CT”.
During the third game station, “Pin the Tail on the M2”, students were timed while completing 3 physical exam maneuvers: palpating the thyroid gland, drawing a line for the location of a tracheostomy incision, and using color doppler with a handheld US to assess the carotid pulse. Accuracy of thyroid gland palpation was determined using handheld US. Students were timed continuously until the task was completed correctly. Five minutes were reserved at the end of each station to review game answers. Points were awarded for each game.
Assessment and Analysis
Following completion of the interactive session, both groups took one version of two 15-question multiple choice post-tests that assessed the anatomy, physiology, physical exam, radiology, and US topics taught during the session. To ensure similar difficulty between the two post-test versions, medical students in their clinical years volunteered to complete both post-tests prior to the study session. A paired t-test was used to analyze the students’ differences in exam scores between post-test A and post-test B and demonstrated no difference between the two (p = 0.5467). The game group initially received post-test A, and the non-game group received post-test B. Two weeks following the session, both groups took a second post-test – the game group completed post-test B while the non-game group completed post-test A. Due to a mistake in post-test B, question #4 was thrown out of analysis. Three reminder emails were sent to all students to encourage completion of the second post-test.
Group demographics were analyzed descriptively. Group differences in pre- and post-test scores were assessed using paired t-tests as well as covariant analyses adjusting for prior US experience. Student experience was evaluated using Likert scales that was then assigned a numerical value for analysis (strongly disagree = 1, strongly agree = 5). Analysis was performed using Jamovi (The jamovi project (2019). jamovi (Version 0.9)).
Demographics and prior US experience of the student in both the game and non-game group are depicted in Table 1.
There were 10 students in each group. The majority of students in both groups were male and had completed a degree related to science or healthcare. Most (19/20) students had less than 10 hours of prior US experience. One student listed 30 hours of prior US experience. Average US experience in the game group was 1.9 hours and 4.65 hours in the non-game group (p = 0.395).
Detailed information about individual student pretest and post-test scores can be found in Table 2.
Table 1. Group Characteristics.
|Characteristic||Game Group||Non-game Group|
|Prefer not to say||0||1|
|Age, mean y||25.3y||23.4y|
|Other STEM degree||3||2|
|Prior healthcare job/volunteering, n|
|Ultrasound experience, mean hr*||1.9hr||4.65hr|
|*Most students (19/20) had <10 hours of previous ultrasound experience; 1 student in the non-game group reported 30 hours (p = 0.395)|
Table 2. Student Pretest and Post-test Scores
|Group||Prior Ultrasound Experience (hr)||Pretest Score (%)||Immediate Post-test Score (%)*||Delayed Post-test Score (%)*|
|Mean, SD||2.0, 2.9||64.0%, 12.6%||94.7%, 5.6%||86.4%, 8.9%|
|Student 6||3.0||40.0%||78.6%||Did not complete|
|Student 7||30.0||60.0%||100.0%||Did not complete|
|Mean, SD||4.65, 9.1||58.0%, 19.9%||83.6%, 7.9%||87.3%, 8.5%|
There were no statistically significant group differences on the pretest when comparing prior knowledge of the session topics between two groups (p = 0.4313, CI = [-0.0966, 0.217]). The game group scored higher than the non-game group on the post-test immediately following the session (p = 0.007, CI = [0.0305, ∞]). There was no significant difference between the groups’ performances on the delayed post-test (p = 0.810, CI = [-0.110, ∞]). When controlling for prior US experience, the game group still did significantly better than the non-game group (p = 0.003) on the immediate post-test while there was still no difference between two groups on the delayed post-test (p = 0.265). Of note, all 10 students in the game group completed the second post-test while only 8 students in the non-game group completed it.
Students in both groups rated their confidence of their knowledge of the material higher following the session. When asked to rate the educational value of the activities the students participated in, those in the game group reported a higher educational value than those in the non-game group (p = 0.010, CI = [0.217, 1.18]). Figure 1 depicts the questions asked of students in both groups regarding overall satisfaction and compares the average response of each group.
All (10/10) of the students in the game group agreed or strongly agreed that the games encouraged teamwork. Most (9/10) felt the games taught the material more effectively than didactic educational methods and did not hinder their learning of the material. Most (8/10) also stated that they would like to see more gamification in their medical school curriculum.
The preclinical years of medical education are undergoing rapid innovation as curricula shifts away from the classroom and towards online learning . Nationally, nearly 25% of second-year medical students reported they almost never attended class during their preclinical years . This educational model threatens important components of preclinical education such as hands-on physical exam techniques and diagnostic methods and undermines continued reinforcement of teamwork amongst peers. The ability to work on a team is essential for effective and efficient healthcare delivery. Creating a curriculum that integrates many clinical disciplines can help preclinical medical students synthesize concepts and better prepare for the wards. For example, Alerhand et al. demonstrated that it was feasible to create a POCUS curriculum which integrated anatomy, pathophysiology, and the physical exam for first-year medical students in their renal course and that students found it increased confidence in their understanding of the material . This study similarly demonstrated that the integration of US, radiology, physical exam, and physiology is effective as a learning adjunct for preclinical medical students and also promotes teamwork amongst them.
Unlike in Canada where The Canadian Ultrasound Consensus for Undergraduate Medical Education Group has recommended 85 US curricular elements for inclusion in all Canadian medical schools including the use of peer teachers, small-group scanning, simulation, and interprofessional training, medical education in the United States has no such consensus[24,25,26]. POCUS, particularly when taught using hand-held portable US devices, is well-suited to teaching US as an adjunct to the preclinical medical school curriculum. It can be incorporated easily through the use of trained senior medical student peer instructors or interprofessional near-peers, especially when access to expert faculty is limited. While US education in the United States has no standardization, this study provides additional evidence to the increasingly growing body of research that medical students desire an US education prior to graduation[7,8,10].
Using gamification in this study increased student confidence, teamwork, autonomy, and motivation to learn by allowing for active learning to promote material retention. Yet the influence of gamification in education remains controversial . Proponents of gamification in education believe the goal of gamification is to encourage an environment that supports learning and productive social interactions, and students seem to perceive this educational environment positively. On the other hand, gamification can be complex and competitive, something that may cater predominantly to learners who are proactive and intrinsically motivated.
Other gamification models used in POCUS education have demonstrated a positive cognitive and behavioral effect for learners. Students in the SonoSlam national medical student US competition  and SonoGames resident competition reported increased confidence and clinical performance. An US game to enhance learning of gastrointestinal anatomy and physiology for first-year medical students by measuring blood vessel velocity was successful in increasing student interaction . This study, too, found that a game model is effective for material retention, at least in the short-term, increases student confidence in the material, and is positively received. But like prior studies, this study failed to demonstrate any differences in long-term retention of the material when comparing student knowledge for those who participated in the games with those who received traditional didactic education.
There is no one right way to incorporate POCUS into medical education. Students prefer small-group educational sessions as compared with large groups . They also report that hands-on practice and the use of video clips in contrast to lectures and still images are more practical for learning . The use of portfolios in higher education has also been shown to foster an improvement in knowledge and understanding of material, increase personal responsibility for learning, emphasize reflection and engagement [32,33] and may be an additional adjunct to POCUS education. This study adds to the body of literature that demonstrates that gamification is a feasible and well-received method to incorporate POCUS into medical education.
The major limitation of this study is the small sample size, though the strength of the study comes from being the first study to compare a group of students who participated in US games to those who participated in a traditional didactic format. The scope of this study was also narrow, as only thyroid and neck material were covered. Results of this study might not hold true for gamification models encompassing other organ systems or for POCUS education as a whole.
Additionally, the material covered in the session aligned with the information students were learning during regular curricular lectures and small group learning. Between the post-test immediately following the session and the delayed post-test, students may have studied the information in variable amounts, affecting retention of the material due to the session education alone. Selection bias may have also influenced results. It is conceivable that if the non-responders had completed the delayed post-test, this may have influenced the outcome.
This ultrasound education model incorporating gamification for preclinical medical students promotes teamwork amongst peers and is as effective, if not more effective, for learning material and retaining knowledge than a traditional learning model. Students appear to react positively towards gamification and feel that it improves their learning and understanding of concepts. Future research should continue to test the use of gamification and US to teach other organ systems and at other stages of medical education. Future studies should also create new games to compare effectiveness of different applications of gamification to education. Although our study did not find an impact of gamification on long-term material retention, future trials should continue to assess if gamification increases information retention in different settings.
The study authors have no disclosures or conflicts of interest to report.
Statement of Ethics Approval/Consent
All subjects who participated in this study gave informed consent. This study was approved by the IRB at Case Western Reserve University.
The authors would like to thank Klara Papp, PhD, for her thoughtful contributions to this study.
1. Melgarejo, S, Schaub, A, & Noble, VE. Point of care ultrasound: An overview. Amer College of Cardiology. October 2017. https://www.acc.org/latest-in-cardiology/articles/2017/10/31/09/57/point-of-care-ultrasound. Accessed March 7, 2021.
2. Melamed, R, Sprenkle, MD, Ulstad, VK, et al. Assessment of left ventricular function by intensivists using hand-held echocardiography. Chest. 2009;135(6):1416-1420.
3. Vignon, P, Dugard, A, Abraham, J, et al. Focused training for goal-oriented hand-held echocardiography performed by noncardiologist residents in the intensive care unit. Intensive Care Med. 2007;33(10):1795-1799.
4. Bahner DP, Goldman E, Way D, et al. The State of Ultrasound Education in U.S. Medical Schools: Results of a National Survey. Acad Med. 2014;89(12):1681–1686.
5. Solomon SD, Saldana F. Point-of-Care Ultrasound in Medical Education — Stop Listening and Look. N Engl J Med. 2014;370(12):1083-1085.
6. Bahner DP, Adkins EJ, Hughes D, et al. Integrated medical school ultrasound: development of an ultrasound vertical curriculum. Crit Ultrasound J. 2013;5(1):6.
7. Birrane J, Misran H, Creaney M, et al. A Scoping Review of Ultrasound Teaching in Undergraduate Medical Education. Med Sci Educ. 2018;28(1):45-56.
8. Hoppmann RA, Rao VV, Bell F, et al. The evolution of an integrated ultrasound curriculum (iUSC) for medical students: 9-year experience. Crit Ultrasound J. 2015;7(1):18.
9. Silver A, Fraser S, Shurey M. Ultrasound in undergraduate medical education. Br Columbia Med J. June 2019. https://www.bcmj.org/letters/ultrasound-undergraduate-medical-education. Accessed April 14, 2020.
10. Davis JJ, Wessner CE, Potts J, et al. Ultrasonography in Undergraduate Medical Education: A Systematic Review. J Ultrasound Med. 2018;37(11):2667-2679.
11. McDougall A. When I say … gamification. Med Educ. 2018;52(5):469-470.
12. Hung, A. A Critique and Defense of Gamification. Jour of Inter Online Learning, 2017;15(1):57–72.
13. Sailer, M, Homner, L. The Gamification of Learning: a Meta-analysis. Educ Psych Review. 2019;32(1):77–112.
14. Lobo V, Stromberg AQ, Rosston P. The Sound Games: Introducing Gamification into Stanford’s Orientation on Emergency Ultrasound. Cureus. 2017;9(9).
15. Lewiss RE, Hayden GE, Murray A, et al. SonoGames. J Ultrasound Med. 2014;33(10):1843-1849.
16. Boulger C, Liu RB, De Portu G, et al. A National Point‐of‐Care Ultrasound Competition for Medical Students. J Ultrasound Med. 2019;38(1):253-258.
17. Connolly K, Beier L, Langdorf MI, et al. Ultrafest: A Novel Approach to Ultrasound in Medical Education Leads to Improvement in Written and Clinical Examinations. West J Emerg Med. 2015;16(1):143-148.
18. Uchida T, Park YS, Ovitsh RK, et al. Approaches to Teaching the Physical Exam to Preclerkship Medical Students: Results of a National Survey. Acad Med. 2019;94(1):129–134.
19. Nelson BP, Hojsak J, Rossi ED, et al. Seeing Is Believing: Evaluating a Point-of-Care Ultrasound Curriculum for 1st-Year Medical Students. Teach Learn Med. 2017;29(1):85-92.
20. Dietrich CF, Hoffmann B, Abramowicz J, et al. Medical Student Ultrasound Education: A WFUMB Position Paper, Part I. Ultrasound Med Biol. 2019;45(2):271-281.
21. Burton WB, Ma TP, Grayson MS. The Relationship Between Method of Viewing Lectures, Course Ratings, and Course Timing. J Med Educ Curric Dev. 2017;4.
22. Association of American Medical Colleges. Medical School Year Two Questionnaire 2017 All Schools Summary Report. 2018. https://www.aamc.org/system/files/reports/1/y2q2017report.pdf. Accessed May 12, 2020.
23. Alerhand, S, Choi, A, Ostrovsky, I, et al. Integrating Basic and Clinical Sciences Using Point-of-Care Renal Ultrasound for Preclerkship Education. MedEdPORTAL. 2020;16(1):11037.
24. Ma IWY, Steinmetz P, Weerdenburg K, et al. The Canadian Medical Student Ultrasound Curriculum: A Statement From the Canadian Ultrasound Consensus for Undergraduate Medical Education Group. J Ultrasound Med. January 2020.
25. Ma I, Wishart I, Kaminska M, et al. Medical educators’ perspectives of teaching physical examinations using ultrasonography at the undergraduate level. Can Med Educ J. 2013;4(1):e59-e68.
26. Tarique U, Tang B, Singh M, et al. Ultrasound Curricula in Undergraduate Medical Education: A Scoping Review. J Ultrasound Med. 2018;37(1):69-82.
27. Ahn JS, French AJ, Thiessen MEW, et al. Training Peer Instructors for a Combined Ultrasound/Physical Exam Curriculum. Teach Learn Med. 2014;26(3):292-295.
28. Smith, CJ, Matthias, T, Beam, E, et al. Building a bigger tent in point-of-care ultrasound education: a mixed-methods evaluation of interprofessional, near-peer teaching of internal medicine residents by sonography students. BMC Med Educ. 2018;18(1).
29. Liteplo AS, Carmody K, Fields MJ, et al. SonoGames: Effect of an Innovative Competitive Game on the Education, Perception, and Use of Point-of-Care Ultrasound. J Ultrasound Med. 2018;37(11):2491-2496.
30. Kafer I, Rennie W, Noor A, et al. Hunger Games: Interactive Ultrasound Imaging for Learning Gastrointestinal Physiology. J Ultrasound Med. 2017;36(2):361-365.
31. Cartier, RA, Skinner, C, Laselle, B. Perceived Effectiveness of Teaching Methods for Point of Care Ultrasound. The Jour of Emer Med. 2014;47(1):86–91.
32. Tochel, C, Haig, A, Hesketh, A, et al. The effectiveness of portfolios for post-graduate assessment and education: BEME Guide No 12. Med Teacher. 2009;31(4):299–318.
33. Buckley, S, Coleman, J, Davison, I, et al. The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teacher. 2009;31(4):282–298.