Submitted: 5 August 2022
Accepted: 2 November 2022
Published online: 4 April, TAPS 2023, 8(2), 76-79
https://doi.org/10.29060/TAPS.2023-8-2/SC2861

Poh-Sun Goh¹ & Elisabeth Frieda Maria Schlegel²

¹Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; ²Department of Science Education, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hofstra University, United States

Abstract

Introduction: The aim of this short communication is to examine the journey of scholarship in health professions education (HPE).

Methods: We will focus on tangible small steps to start, sustain, and succeed along this journey. Through a proposed innovation in scholarship – micro-scholarship – we will describe how this is similar to and an extension of bite-size or micro-learning, and workplace micro-practice related to just-in-time (JiT) learning settings.

Results: We will demonstrate how the small steps for generating and engaging with micro-content can be similarly applied to micro-scholarship. Then, progressive and iterative refinement of output and practice of micro-scholarship can be combined and result in macro-scholarship after cycles of public engagement for final digital or print publication. This stepwise approach creates an accessible, sustainable strategy to achieve success as a scholar in HPE. We will elaborate on micro, macro, and meta matters and celebrate how these small steps encourage and allow broad participation in the creation, critique, and progressive refinement of scholarship.

Conclusion: Small, sustainable, steps leads to success as a scholar in Health Professions Education – Micro (macro and meta) matters.

Keywords:           Micro-Scholarship, Micro-Learning, Just-In-Time (JiT) Learning, Community of Practice (CoP), Technology, Network Effects, Post-Publication Peer Review (PPPR)

I. INTRODUCTION

Modern changes in the pace and way we conduct and experience teaching and learning have resulted in production and consumption of smaller chunks of content. Succinct, bite-size content is easier to remember and consumes less cognitive bandwidth with reduced cognitive load. In addition, it is also significantly easier to share and engage with within a professional community of practice (CoP). Compact modular, bite-size content is also ideal for just-in-time (JiT) micro-learning and workplace micro-practice (Yilmaz et al., 2022), or on-demand learning and practice, with which we are all familiar. In this paper, we will extend this idea of micro-learning and micro-practice to scholarship, by examining the “new” idea of micro-scholarship – defined as “the process of making visible the smallest accessible and assessable steps that document a scholarly journey, which can then be assembled and presented as an outcome of academic scholarship” (Goh et al., 2021). Mobile technology tools and platforms support open display, access to, and iterative engagement with this content by a community of practice (CoP), both in learning and scholarship (Goh et al., 2021; Goh & Sandars, 2020; Schlegel, 2021).

II. MICRO-MATTERS

Just as a musical composition is made up of individual notes, a construction from its individual parts, and a meal of its individual ingredients, commonly accepted and acknowledged finished works of scholarship in HPE are composed of its individual parts. A conference presentation or journal paper, peer reviewed, read by and engaged with by a CoP, contains core components – e.g., the title (which includes key ideas); key words (which are defined and illustrated in the presentation or paper); and cited published work by earlier authors (from a review of the field, including takeaways from the author(s) that are relevant and that the authors intend to discuss, elaborate, and build upon). However, a close examination and reflection of these core parts of finished works of scholarship show that they not only form the ingredients of the final work, but that they also fall within the categories of scholarship proposed by Boyer, with evaluation criteria described by Hutchings and Shulman; (Goh et al., 2021; Goh & Sandars, 2020). Boyer’s model for scholarship includes (1) integration, (2) application, (3) teaching and learning, and (4) discovery.

Innovative JiT micro-content on mobile platforms is easily accessible for members of a CoP to engage with, evaluate, critique, and build upon. All online content, including, e.g., on Twitter, blogs, or modular courses, is subject to creative reader collectives, which post comments, repost, reshare, and create new meaning and value from individual posts of content, contributing to group engagement, which has many of the characteristics of scholarship (Schlegel & Primacio, 2021). We propose that these artefacts and activities illustrate examples of Boyer’s Scholarship categories, including demonstrating the Scholarship of Teaching and Learning SoTL. Digital and online content and platforms support and scale our efforts as learners and scholars, no different yet more facile as compared to in-person activities, with increased importance placed on being a public professional, and respecting intellectual property, shown by proper citation of digital content, and use of this content with permission where applicable, followed by data-driven dissemination (Arrington & Cohen, 2015; Kern et al., 2015). This public reaction and appraisal of content compares to wide audience post-publication peer review (PPPR) with the added value of a feedback-loop through responses on comments. Just as developing bite-size, short format, JiT digital, online content, has transformed and continues to transform our educational and professional practices, a similar process can now facilitate and support granular, open digital display and engagement of both our initial and subsequent steps when engaging in scholarship in HPE, similar to and an extension of micro-learning. Practicing micro-scholarship involves encountering a “new idea”; researching its meaning; adding relevance to specific discussion themes and takeaways; discovering key published and presented work; and then both taking note of and making notes on these findings during reflection and discussions within a local CoP. This micro-scholarship is subsequently made open and visible to a global readership or a CoP, through private, semi-private, and public engagement platforms. Micro-scholarship content gets progressively refined through iterative engagement with members of a CoP, through discussion, feedback, critique, and personal reflection. The relevance and usefulness of this content, as well as confidence in the authors of this micro- scholarship content, is progressively enhanced. We also learn how and where this content is best disseminated and presented, and best ways this might be combined and stacked. The iterative in- person and scalable digital conversations amplifying the spread and engagement with this material to create meaning, in step-by-step fashion, form the core practices of both micro-scholarship (Goh et al., 2021) and bite-size engagement with material (Schlegel, 2021). After refinement, these pieces can be combined into larger pieces of finished work of macro-scholarship. Thus, activities undertaken as part of micro-learning or micro-scholarship are accessible, independent, and sustainable small, step-wise efforts that can and do add-up. Progression along the developmental path of a scholar will include a variety of conversations within a CoP, such as the supportive networks of peers, senior practitioners, mentors and coaches, including collaborative (team)work and initially supervised instruction as part of a successful scholar’s journey. Conversations and engagement within a CoP do range from positive and helpful to (those that are or perceived to be) occasionally provocative and challenging. However, professional and good-natured discussion generally guide scholarly development similar to trial and error, and progressive improvement and iterative steps enable learning and growth.

III. MACRO-MATTERS

Simply put, a finished larger work is made up small pieces that have been selected and refined, through an iterative process of reflection and feedback, by engaging with a CoP or specialised collective of readers. Open (digital) practice from an early stage, the platforms (places and readers) we engage in, and our active participation in professional CoP of global specialised readers provide both “informed” and “critical” feedback – and review of these “early” and “small” or “micro” pieces of work – from a (much wider) audience. The key distinction is who engages with this work, from as wide a spectrum of professional practice, experience, and expertise as possible, and from a diversity of points of view. Digital tools and practices facilitate and scale this process. This is similar to the work of artists, who engage in open sketching, including showcasing early drafts and ideas, prototyping, drawing, and artistic creation in open studios. When members of a CoP engage through digital platforms the impact from their individual and collective input can scale exponentially through network effects (Azhar, 2021).

IV. META-MATTERS

The process of scholarship mirrors the stepwise, sequential, cumulative process of learning, and training for proficiency and mastery in any area of practice. Our roles as practitioners, educators and scholars are all informed by learning science. Digital devices, tools, platforms, and practices exponentially scale up the impact of our efforts through applied network theory and interactions. Ultimately, we live and practice professionally within our CoP, which provides both the audience and peer reviewers of our public work, thus driving a fruitful evolution of our profession. Our ultimate aim is to engage a CoP in conversations, including broader participation in the production, refinement, and consumption of products of scholarship, in form and format, and through processes accessible for all. Micro-scholarship is a starting point that allows wider participation and engagement in the process of scholarship. The components of micro-scholarship, when refined and confidently presented, are contained within published finished macro-scholarship outputs. Then, micro-scholarship and macro-scholarship add collaboration and value within a larger scholarship ecosystem and professional CoP, a meta-level practice or meta-system, within which micro- and macro- level activities occur. An explicit example of the outputs and process of moving from micro, through macro, to meta practice illustrated https://www.slideshare.net/dnrgohps/illustrated-stacked-microscholarship-steps-along-academic-path-of-educational-scholar.

Another example of enhancing scholarship of teaching and learning SoTL across different levels might include, e.g. a remote consultation with members of scholarly project teams, prompting to publish a themed blog post, which, in return, becomes now a generalizable, transferrable offering to the global CoP, moving from the meta-system to the macro-level, as evidenced by comments from different institutions and subsequent implementation of ideas (Arrington & Cohen, 2015).

V. CONCLUSION

In this paper, we have examined, showcased, and celebrated the small sustainable steps to success as a scholar in HPE, describing micro, macro, and meta matters and illustrating how combining small components of scholarship is an effective strategy for dissemination, access, engagement, conversation and collaboration within a CoP in HPE.

Notes on Contributors

Poh-Sun Goh pitched initial idea, was involved in active discussion and brainstormed with co-author iterative refinement of core message(s), wrote first draft, and actively revised series of subsequent drafts, and submitted final draft. This manuscript built on previous collaborative work, cited in article on Micro-Scholarship and Digital Scholarship.

Elisabeth Schlegel was involved in active discussion and brainstormed with co-author iterative refinement of core message(s), and actively revised series of subsequent drafts, and including and approving final draft. This manuscript built on previous work, cited in article including on bite-sized learning.

Ethical Approval

As this manuscript is a description of an innovative approach to scholarship, ethical approval and IRB application was not required.

Data Availability

There is no additional data separate from available in cited references.

Acknowledgement

No technical help and/or financial and material support or contributions was received in preparation of this manuscript.

Funding

Both authors have no funding source to declare.

Declaration of Interest

Both authors declare that there are no possible conflicts of interest, including financial, consultant, institutional and other relationships that might lead to bias or a conflict of interest.

References

Arrington, N. M., & Cohen, A. L. (2015). Enhancing scholarship of teaching and learning through micro-level collaboration across two disciplines. International Journal of Teaching and Learning in Higher Education, 27(2), 194. 

Azhar, A. (2021). The exponential age: How accelerating technology is transforming business, politics and society. Diversion Books.

Goh, P. S., Roberts-Lieb, S., & Sandars, J. (2021). Definition of Micro-Scholarship. https://microscholarship.blogspot.com/

Goh, P. S., & Sandars, J. (2020). Rethinking scholarship in medical education during the era of the COVID-19 pandemic. MedEdPublish, 9(97). https://doi.org/10.15694/mep.2020.000097.1

Kern, B., Mettetal, G., Dixson, M., & Morgan, R. K. (2015). The role of SoTL in the academy: Upon the 25th anniversary of Boyer’s scholarship reconsidered. Journal of the Scholarship of Teaching and Learning, 15(3), 1-14. https://doi.org/10.14434/josotl.v15i3.13623

Schlegel, E. (2021). (Not only) for medical students: Get involved in medical education research & scholarship. https://elisabeth-fm-schlegel.weebly.com/elearning-bites/not-only-for-medical-students-get-involved-in-medical-education-research-scholarship

Schlegel, E., & Primacio, J. (2021). Blogging for the continuum of medical education: Engaging diverse communities of learners. MedEdPublish, 10, Article 136. https://doi.org/10.15694/mep.2021.000136.1

Yilmaz, Y., Papanagnou, D., Fornari, A., & Chan, T. M. (2022). The learning loop: Conceptualizing Just-in-Time faculty development. AEM Education and Training, 6(1), e10722. https://doi.org/10.1002/aet2.10722

*Poh-Sun Goh
Department of Diagnostic Radiology
National University Hospital,
Main Building, Lobby F, Level 4
#04-398, DDI Library
5 Lower Kent Ridge Road, Singapore 119074
+6567724211
Email: dnrgohps@nus.edu.sg

Submitted: 28 April 2022
Accepted: 19 August 2022
Published online: 4 April, TAPS 2023, 8(2), 70-75
https://doi.org/10.29060/TAPS.2023-8-2/SC2802

Sok Mui Lim, Ramesh Shahdadpuri & Ching Yee Pua

Centre for Learning Environment and Assessment Development (CoLEAD), Singapore Institute of Technology, Singapore

Abstract

Introduction: Coaching has gained acceptance in the education field as a way to enable learners to achieve their fullest potential. In the endeavor to set up a coaching ecosystem in our university, we started by equipping our educators with fundamental coaching skills and techniques. Our training workshop, Coaching As An SIT Educator, covers the key coaching competencies and is highly practice focused. Participants get hands-on skills practice using contextualised scenarios that are based on realistic academic, workplace and clinical placement settings.

Methods: To address concerns on time-effectiveness, we adopt a solution-focused approach to coaching. We want to create a mindset shift for educators, from subject experts providing advice and solutions, to coaches asking powerful coaching questions that help students make discoveries and work towards their goals. We encourage our educators to engage students holistically by finding coachable moments in their daily student interactions.

Results: Competency-based assessments are conducted to determine achievement of the learning outcomes, articulated by the knowledge, attitude, and demonstration of coaching skills with students. Assessments consist of a reflection, multiple-choice question (MCQ) quiz, and scenario-based coaching role plays. Participants achieved the learning outcomes as demonstrated from the assessments.

Conclusion: The coach training workshop is the major pillar of our coaching initiative. Beyond the workshop, ongoing coaching development is supported through other activities and resources, including community of practice, coaching circle and knowledge repository. Opportunities for continuous learning and conversation platforms for sharing coaching experiences are part of the growing coaching ecosystem at SIT.

Keywords:           Assessments, Coaching Competencies, Coaching Conversations, Coaching Ecosystem, Coachable Moments, Faculty Development, Feedback, Holistic Development, Solution-Focused

I. INTRODUCTION

Coaching has gained greater awareness and wider acceptance in the education field in the past decade, led by the efforts of innovative educators and more evidence-based research. Coaching has been described as a very powerful approach that facilitates personal and professional change through deep level listening, questioning, setting the right challenges and providing support along the process (Griffiths, 2005). More specifically, academic coaching is defined as individualised practice of asking students reflective, motivation-based questions, providing opportunities for formal self-assessment, sharing effective strategies, and co-creating a tangible plan that promotes accountability (Deiorio et al., 2017).

In traditional educational settings, communication tends to be mostly directive, where the educator is the subject expert who gives instructions, solutions or advice to students. From this “telling” or “pushing” stance where the focus is on problem solving and advice giving, shifting to coaching conversations requires an “asking” or “pulling” communication approach. Engaging in coaching conversations involves the educator coaching students through powerful questioning, active listening and guiding them to explore possibilities so as to discover new ideas and find solutions for themselves.

In 2020, Singapore Institute of Technology (SIT) introduced internal coach training for all academic staff with the aim to build educators’ capability to work with students at a deeper level. This highly contextualised academic coaching training was made mandatory for all educators. This was essential for the creation of a strong coaching ecosystem in the university and adopting coaching practices across a variety of learning contexts, such as providing assignment feedback, consultations on projects and supervising students at the workplace. In working with students towards their preferred futures, SIT educators can help the students develop confidence and self-efficacy, enabling them to achieve their fullest potential. 

II. METHODS

This section highlights the critical elements of the faculty development programme.

A. Solution-focused Approach

One of the top concerns of many educators is time. There are underlying concerns on whether coaching students will take up too much time, and what happens if they uncover student issues that they cannot deal with. A solution-focused coaching approach alleviates some of these concerns. The basic principle of the solution-focused approach is to help coachees reflect and design their solutions, rather than go down the path of root cause analysis. Its forward-oriented solution approach contrasts with other traditional psychological techniques, which tend to look back at the past or are problem-focused (Grant & Gerrard, 2020).

The solution-focused approach is known for its simplicity, attention to language and time effectiveness. The conversation is steered to a preferred future of the issue at hand without dwelling on the troubled past. The coach encourages the coachee to focus on their strengths and positive resources, to think about their resourceful past, and to draw on positive lessons from when they have been at their best. After identifying their desired outcomes and considering their options in the context of present realities, the coach guides the coachee to think about the next steps to progress towards their preferred future.

B. Mindset Shift

In higher education, many coachable opportunities outside the formal contact hours can be easily missed. For example, instead of merely deducting marks for repeated late submissions of assignments, the educator could coach the student on improving time management. In clinical fieldwork, when a student complains about limited interaction with the busy clinical educator, the university supervisor can coach the student on how best to schedule time for feedback. Our daily encounters and interactions with students present many coachable moments that offer just-in-time and authentic learning opportunities to support students in their development to become work-ready graduates.

Students may initially find coaching sessions difficult as it is easier to just ask for solutions than to discover solutions for oneself. However, with time, students will realise the value of coaching as they witness their progress. In an Asian context, where many students are respectful and value advice from authoritative figures, such as professors, coaching can require a mindset shift for both students and faculty (Lim, 2021).

C. Tailoring the Coaching Training to Education Context

The Coaching As An SIT Educator workshop is an in-house designed 2-day program. It is highly contextualised for the needs of SIT academic staff, to equip them to be versatile and agile educators, performing the role of Teacher-Coach-Mentor.  The workshop covers the key coaching fundamentals and is highly practice-oriented. The programme design was intended for participants to develop hands-on coaching skills with contextualised role play scenarios (see Appendix A for an example), so that they can apply what they have learnt with their students immediately after the workshop.

While we do not intend to train credentialed professional coaches, the key International Coaching Federation (ICF) coaching competencies were referenced to guide the design of the SIT workshop. The GROW model (Whitmore, 2019) was introduced as a framework for the participants to organise and manage the flow of the coaching conversation. Drawing on inputs from academic staff, realistic student-centric scenarios were created for class discussions and role plays. The coaching practice sessions are conducted in dyad, triad, and hot seat formats. The workshop design and facilitation ensure that there is psychological safety, providing a trusting space for constructive debriefing, feedback sharing and open questions and answers to take place.

To manage the workshop time and resources effectively, e-learning content was developed in-house, specifically to complement the interactive classroom session. A week before the start of the workshop, the participants can access materials in the form of an asynchronous pre-recorded webinar. The webinar consists of five micromodules, covering topics such as Mindset, Motivation, Emotional Intelligence, and Feedback Skills (refer to Appendix B for more details). As many participants may already be familiar with these topics, this self-learning component serves as a good refresher to prepare participants for the coaching workshop.

Please refer to Table 1 for details of the Coaching as An SIT Educator workshop.

Workshop: Coaching As An SIT Educator
Learning Outcomes By the end of this course, participants will be able to: Articulate the role and responsibilities of a coach/mentor in educational settings; Demonstrate listening, questioning and feedback skills to have good coaching conversations; Apply the GROW coaching model to conduct coaching sessions; Show empathy to build rapport and foster good relationships; and Implement coaching/mentoring in academic and workplace attachment settings to achieve the desired programme outcomes.
Topics Covered
Pre-Workshop: eLearning Mindset & Motivation Emotional Intelligence (EQ) Feedback Skills What Is Coaching?	Workshop Day 1: Introduction Coaching & Mentoring Fundamentals Coaching Tools & Techniques; Coaching With GROW Model   Workshop Day 2: War Stories From Coaching as Internship Supervisor Mentoring Versus Coaching Getting Feedback On Your Coaching Summary & Closing
Assessments (Day 2)
Role Plays: Standardised Students & Assessors Scenarios (each – 20 minutes): Academic Context Workplace Attachment	Quiz: Multiple Choice Questions (MCQs) Emotional Intelligence Building Rapport & Trust Coaching Conversations Coaching Process: GROW Model Role Of Educator-Coach

Table 1. Coaching As An SIT Educator Workshop

III. EVALUATION OF COACHING COMPETENCY

To assess the attainment of the learning outcomes and development of the participants’ coaching competence (knowledge, skills, attitude), assessments and reflection exercises are incorporated into the workshop. As this is not a certification program, assessments are formative in nature, with focus on providing the educators quality feedback. Coaching knowledge is assessed through a multiple-choice question (MCQ) quiz.  Attitude and mindset shift is evaluated through pre- and post- workshop surveys, and reflection questions.

Coaching skills are assessed via role plays (with standardised students). The role play format involves two 20-minute coaching sessions with the participant (playing the role of an educator) having a coaching conversation with standardised students (who act as coachees) and are conducted virtually in real time over the Zoom platform, using breakout rooms. The role plays that are based on common scenarios in university and workplace supervision settings. An invaluable part of the learning in this assessment comes from the feedback conversation between the participant (coach) and assessor, who observes the coaching conversation. Many participants regard the skills assessment and individualised feedback on their coaching skills as the highlight of the training programme.

IV. DISCUSSION

Many readily available coaching materials or vendor-run workshops are geared towards executive or corporate scenarios. While the skills of coaching may be transferable, it is difficult for educators to draw relevance to student engagement. Therefore, Coaching As An SIT Educator workshop focuses on case studies of university scenarios, and supervision for work-integrated learning (e.g., internship, clinical placement). Participants get to work with fellow learners in group work and discussions, to engage in personal reflection, and takeaway practical knowledge and skills on their learnings in a safe space.

For a sustained effort to practice coaching and build an on-going coaching culture, a mandatory workshop is inadequate. Other coaching resources are available to support coaching practice and promote continuous learning in SIT:

• Community of Practice: Coaching Conversations @SIT (offered to any interested academic staff)
• Coaching Circle (offered to all alumni of the coaching workshop)
• Coach Academy (knowledge repository with academic and coaching industry resources).

V. CONCLUSION

In coaching, there lies great potential for students to be developed holistically if we tap on coachable moments in higher education. A contextualised, well-developed coaching development programme is an enabler for this potential to be fulfilled. Drawing on evidence-based research from academia and professional practice, a practice-oriented programme which focuses on developing hands-on coaching skills will be impactful, as educators can put these skills into action in their interaction with students.

Notes on Contributors

Associate Professor Lim Sok Mui (May) led the Center for Learning Environment and Assessment Development (CoLEAD) and spearheaded the coaching initiative in the university, contributed to the conception, drafted and critically revised the manuscript.

Ramesh Shahdadpuri is the senior educational developer in CoLEAD and plays the role of the coaching trainer for the faculty training program. reviewed the literature, contributed to the conception and assisted in revising the manuscript.

Pua Ching Yee is the learning analyst in CoLEAD and plays the role of coordinating the coaching training and assessment of the participants. She assisted in critically reviewing, revising and formatting the manuscript.

All authors gave their final approval and agree to be accountable for all aspects of the work.

Ethical Approval

This is a narrative review related to coaching training program with no data presented and no ethical approval is required.

Data Availability

This paper is a narrative review with no data analysis.

Acknowledgement

The authors would like to thank Miss Cherine Foo for her significant contribution of the coaching program.

Funding

There is no funding involved in the preparation of the manuscript.

Declaration of Interest

The authors declare no conflict of interest.

References

Deiorio, N. M., Skye, E., & Sheu, L. (2017). Introduction and definition of academic coaching. In N. M. Deiorio & M. M. Hammoud (Eds.), Coaching in medical education: A faculty handbook (pp. 1-5). American Medical Association.

Grant, A. M., & Gerrard, B. (2020). Comparing problem-focused, solution-focused and combined problem-focused/solution-focused coaching approach: solution-focused coaching questions mitigate the negative impact of dysfunctional attitudes. Coaching: An International Journal of Theory, Research and Practice, 13(1), 61-77. https://doi.org/10.1080/17521882.2019.1599030 

Griffiths, K. (2005). Personal coaching: A model for effective learning. Journal of Learning Design, 1(2), 55–65. http://dx.doi.org/10.5204/jld.v1i2.17

Lim, S. M. (2021, May 27). The answer is not always the solution: using coaching in higher education. Times Higher Education. https://www.timeshighereducation.com/campus/answer-not-always-solution-using-coaching-higher-education

Whitmore, J. (2019). Coaching for performance: The principles and practice of coaching and leadership (5th ed.). Nicholas Brealey Publishing.

*Lim Sok Mui
Singapore Institute of Technology,
10 Dover Drive, Singapore 138683
+65 65921171
Email: may.lim@singaporetech.edu.sg

Submitted: 4 October 2022
Accepted: 5 December 2022
Published online: 4 April, TAPS 2023, 8(2), 66-69
https://doi.org/10.29060/TAPS.2023-8-2/SC2894

Simon Field¹, Pat Croskerry², Susan Love³, & Peggy Alexiadis Brown⁴

¹Undergraduate Medical Education and Emergency Medicine, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada; ²Critical Thinking Program, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada; ³Faculty Development, Continuing Professional Development, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada; ⁴Dalhousie Medicine New Brunswick, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada

Abstract

Introduction: For all clinical providers in healthcare, decision-making is a critical feature of everything they do. Every day physicians engage in clinical decision-making where knowledge, evidence, experience, and interpretation of clinical data are used to produce decisions, yet, it is fair to say that most do not have an explicit insight or understanding of this complex process. In particular, few will have training in teaching and assessing the cognitive and affective factors that underlie clinical decision-making.

Methods: To foster an increased awareness and understanding of these factors, the Dalhousie Critical Thinking Program was established with the mandate to develop and deliver curriculum for critical thinking in the 4-year undergraduate program. To assist teaching faculty with the goal and objectives of the program, the Teaching and Assessing Critical Thinking Program (TACT) was introduced.

Results: Using the dual process model as a platform for decision-making, this program introduces general principles of critical thinking and provides tools to teach learners how to strengthen their critical thinking skills. To offer flexible learning, an online approach was chosen for delivery of the program.

Conclusion: To date, we have offered eleven iterations of Part 1 to a total of 261 participants and six iterations of Part 2 to a total of 89 participants. Evaluations show the online approach to content delivery was well received and the content to be of practical use.

Keywords:           Critical Thinking, Clinical Decision-Making, Faculty Development, Asynchronous Learning

I. INTRODUCTION

This paper provides a review of a two-part Teaching and Assessing Critical Thinking (TACT) program which was developed to help faculty understand vulnerability to bias and the role of metacognitive processes in clinical decision-making. The objective of the TACT program is to better prepare faculty to teach learners these important skills. In this paper, we describe how it was implemented, how participants perceived the program, and what changes were needed to address this important hidden ‘soft’ skill within the clinical setting. 

II. METHODS

Physicians are constantly required to interpret information when they interact with patients, communicate with colleagues, review medical histories and laboratory reports, conduct physical exams, review the medical literature, and attend rounds. All of these clinical activities demand a sustained level of accuracy, clarity, and especially rationality. Critical thinking (CT) does not guarantee rationality but is one of its more important features and is essential for the role of physician.

Reliable and accurate diagnosis is the barometer of good clinical decision-making and will have a direct impact on treatment outcomes and patient safety. One in 20 (or roughly 12 million) American adult outpatients are affected by diagnostic errors every year. The overall number of fatalities associated with diagnostic failure is not known, but it is estimated that 40,000 – 80,000 deaths occur annually in hospitalised patients in the USA due to diagnostic failure.

A number of studies have shown that training in the development of CT skills in undergraduate students is effective. (Abrami et al., 2015) However, given that most faculty in medical schools today will not have had explicit CT training, specific initiatives in teaching it seem appropriate, not only for the faculty themselves but, importantly, for the students they teach.

To better prepare learners, Dalhousie’s Faculty of Medicine established the Critical Thinking Program in 2012. The program incorporated principles from the Foundation for Critical Thinking into a general model of clinical reasoning (Croskerry, 2018). The Dalhousie critical thinking curriculum reflects a consensus in the current medical literature that the dual process model (System 1 and System 2) is the most appropriate platform for reviewing the clinical decision-making process (See Figure 1).

Figure 1. The Dalhousie University model for clinical decision making. (Reproduced with Permission)

A key component in the delivery of this curriculum is helping faculty develop the skills they will need to teach and mentor critical thinking in the clinical environment. Most educators have limited understanding of the advances in medical decision-making and how to best teach critical thinking and clinical reasoning. 

The TACT Program comprises two distinct courses: TACT 1 and TACT 2. The program is structured to develop a sound knowledge of critical thinking principles in TACT 1, followed by a focus on teaching and learning in TACT 2. TACT 1 centres on three main themes:  How Physicians Make Decisions, Cognitive and Affective Biases, and Cognitive Debiasing Strategies. TACT 2 centres on two main themes: Fundamentals of Medical Education and Strategies for Teaching and Assessing CT.  In TACT 2, participants choose one of four elective options: Evidence Based Medicine, Competency Based Medical Education, Medical Humanities, or Curriculum Development. 

The TACT Program uses an asynchronous online approach to reach Dalhousie faculty who are distributed across the Canadian Maritime Provinces. This approach mediates potential barriers for participation such as distance and time constraints and allows for individualised learning experiences while building an interactive online community of practice experience (Cook & Steinert, 2013). We use a combination of curricular tools including online didactic lectures, independent study activities, webinars, and discussion boards.

To date (Winter 2022), we have held 11 iterations of TACT 1 and 6 iterations of TACT 2, with 163 of 261 participants completing TACT 1 and 78 of 89 registrants completing TACT 2.

Of those who completed TACT 1, 55 % went on to enrol in TACT 2.   

We initially developed the TACT Program for Dalhousie faculty (primarily physicians); however, due to growing interest in the topic, we have opened enrolment to include participants from around the world, including the United States, Mexico, United Kingdom, Australia, New Zealand, Turkey and Brazil. We also opened enrolment to participants from a variety of health professions and other fields of study. By opening the program to participants with diverse backgrounds in practice and location we have increased the diversity of perspectives and the richness of reflections posted to the discussion boards.

Prior to starting the TACT Program, we asked participants to complete a survey measuring their current knowledge of teaching and assessing CT, and motivation for taking the course.

Participants reported little satisfaction with previous knowledge in CT (Mean: 2.67 ± 0.84 on a Likert Scale of 1 (not at all satisfied) to 5 (very satisfied)). The following themes were identified as motivators for taking the TACT Program — a desire to: learn, improve clinical reasoning by increasing knowledge, understand the impact of critical thinking, provide better clinical care, decrease diagnostic error, and become a better educator.

We administered a summative evaluation following both TACT 1 and TACT 2.  For TACT 1, 75% (121/162) completed the final evaluation and for TACT 2, 90% (63/70). In the summative evaluation, we asked participants to rate their course in a number of areas from course delivery to the effectiveness of increasing their knowledge and comfort in teaching critical thinking. Consent to data collection was implied as part of the administration of the evaluation. We found that participants were very satisfied with delivery methods.

III. RESULTS

A. What Did We Learn about the Participants?

All participants taking the TACT Program shared a similar motivation: the intent to improve their critical thinking skills and to teaching others.  Steinert et al. (2002) found that faculty are more likely to enrol in an online program if they believe it would meet a perceived need. Our participants identified a desire to improve their own practice, confidence and awareness, to make the unconscious conscious, and to develop the language to name, identify and act on cognitive biases and those circumstances that create biases.  This enabled them to better teach and mentor CT.

Participants also identified the value of communicating with others who offered a different perspective on clinical work and life experiences.

Physicians may not readily share/disclose mistakes they make in the clinical setting. In medical training environments, overconfidence and reluctance to admit mistakes are often the norm, which may work against fostering a culture of reflection (Brezis et al., 2016). Due to the confidentiality of the discussion boards, our participants could freely reflect on what factors contribute to errors they have made/seen and share those lessons with peers without fear of loss of reputation and embarrassment.

B. What Did We Learn about the Delivery?

We found that the online delivery was successful in reaching a broad base of participants. Some participants appreciated the mode of delivery as well.

A benefit of online courses is the ease with which faculty can control their pace of instruction. When asked, we found that 97.4% of respondents identified they would do more faculty development programs online.

When we reviewed the online tracking statistics, we found that our participants were accessing materials at all hours. Participants, each with their own learning style, appreciated the mix of interactivity and self-study the online format offered.

IV. DISCUSSION

Ideally, we would like to know how effectively participants in the TACT program incorporated the teaching principles into their own practices in the real clinical world. However, it is very challenging methodologically to do this, and it appears the best we can do is to ask about participant impressions and insight into their experience.

It appeared that the TACT program provided a rich opportunity for participants to interact and share their quest to understand and refine the metacognitive aspects associated with their clinical decision-making and critical thinking processes. It also provided our participants with the language to describe and teach these processes to trainees.

V. CONCLUSION

In summary, the TACT program shows promise in engaging distributed faculty to further their curiosity and interest in how to improve, teach and foster critical thinking skills within medical education and in their own practice.  We recognise that although this online asynchronous mode of delivery may not be appropriate to meet the diverse learning styles of all potential participants, the favourable reviews we have received from our program graduates highlighted that the flexible interactivity with the content contributed to the success of the TACT program.

Notes on Contributor

Simon Field assisted in the initial development of the TACT program and contributed to the data analysis and writing of the article.

Pat Croskerry was a founding member of the Critical Thinking Advisory Group, and contributed to the development of the TACT program and to the writing of the article.

Susan Love has been an active contributor to the running of the TACT program, designed the survey tools, collected and analyzed qualitative and quantitative data from the program evaluation, and contributed to the writing of the article.

Peggy Alexiadis Brown collected and analyzed qualitative and quantitative data from the program evaluation survey tools, and contributed to the writing of the article.

All authors have reviewed and approved the final manuscript.

Ethical Approval

The data gathered for this article was collected anonymously as part of Program Evaluation, and a written waiver has been obtained stating that it is exempt from full institutional Research Ethics approval.

Acknowledgement

We acknowledge the valuable support and contribution of Deirdre Harvey and other members of the Critical Thinking Advisory Group. For further information on how to implement a similar program in your region, please feel free to contact us.

Funding

There is no funding associated with this project.

Declaration of Interest

None of the authors have any conflicts of interest to declare, and they do not receive any financial assistance or funding for their participation in the TACT program.

References

Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015). Strategies for teaching students to think critically: A meta-analysis. Review of Educational Research, 85(2), 275-314. https://doi.org/10.3102%2F0034654314551063

Brezis, M., Orkin-Bedolach, Y., Fink, D., & Kiderman, A. (2016). Does physician’s training induce overconfidence that hampers disclosing errors? Journal of Patient Safety, 15(4) 296-298. https://doi.org/10.1097/pts.0000000000000255

Cook, D. A., & Steinert, Y. (2013). Online learning for faculty development: a review of the literature. Medical Teacher, 35(11), 930-937. https://doi.org/10.3109/0142159X.2013.827328

Croskerry, P. (2018). A model for clinical decision-making in medicine. Medical Science Educator, 27(Suppl 1), S9-S13. https://doi.org/10.1007/s40670-017-0499-9

Steinert, Y. L., McLeod, P. J., Conochie, L., & Nasmith, L. (2002). An online discussion for medical faculty: An experiment that failed. Academic Medicine., 77(9), 939-940. https://doi.org/10.1097/00001888-200209000-00046

*Simon Field
Dept of Emergency Medicine,
Dalhousie University, Halifax,
Nova Scotia, Canada
Email: simonfield@dal.ca

Submitted: 16 March 2022
Accepted: 26 May 2022
Published online: 4 April, TAPS 2023, 8(2), 57-65
https://doi.org/10.29060/TAPS.2023-8-2/OA2778

Vijay Kautilya Dayanidhi¹, Arijit Datta², Shruti P Hegde³ & Preeti Tiwari⁴

¹Department of Forensic Medicine, Medicine, Manipal Tata Medical College, MAHE, India; ²Department of Forensic Medicine, Medicine, Pramukhswamy Medical college, India; ³Department of Ophthalmology, Medicine, Manipal Tata Medical College, MAHE, India; ⁴Department of Community Medicine, Medicine, Pramukhswamy Medical college, India

Abstract

Introduction: Summative assessments play a major role in shaping the student’s learning. There is little literature available on validity of summative assessment question papers in Forensic Medicine & Toxicology. This study analyses 30 question papers from 6 reputed universities for content validity.

Methods: A retrospective cross-sectional record-based observational study was conducted where 30 university summative question papers in Forensic Medicine & Toxicology from 6 universities across India were evaluated for content validity. The learning domain assessed, the type of questions asked, and sampling of the content was compared and presented in the results.

Results: From the results of the study, it was noted that 80% weightage was allotted to recall in most papers and only one paper tested for application. 70 to 80% of the marks were allotted to Forensic Pathology leading to disproportionate sampling. Core areas in Toxicology and Medical Jurisprudence were sparsely assessed. 

Conclusion: The content validity of the summative question papers in Forensic Medicine and Toxicology was unsatisfactory, emphasising the need for evaluation of the clarity and efficacy of the blueprints being used by the universities. Faculty training to motivate and influence a change in the mindset is necessary to bring about a course correction.

Keywords:           Forensic Medicine & Toxicology, Summative Assessments, University Assessments, Blueprint, Content Validity, Learning Domains

Practice Highlights

• Content validity of the Forensic Medicine & Toxicology university exam question papers form six universities was studied.
• It was observed that certain subtopics like Forensic Pathology over time have been over value (80% Weightage).
• Core areas in Medical Jurisprudence and toxicology like substance abuse, environmental toxicology, and pharmaceutical toxicity have been undervalued.
• None of the QPs analysed tested for application. Most items in the assessment tested only recall.
• The blueprints for the paper setters, considering the competencies to be assessed must be designed and validated.

I. INTRODUCTION

Reflecting on our learning experience during MBBS, we realised that we have always had issues with the examination system. The questions are vague and clustered around few important topics. Undergraduate students look up to previous examination question papers as references to decide the stake to be allotted to the topics while preparing for examination. Invariable all students attempt to predict the examination pattern and allot appropriate time and efforts to different subjects, skills, and topics. This reiterates George E Miller’s quote “Assessment drives Learning”. Summative assessments need to be planned appropriately as medicine has high stakes (Amin et al., 2006). Properly designed and executed assessments are known to have a “positive steering effect on the student’s learning. They are also needed to evaluate the programs. Improper assessments can drive a hidden curriculum leading to a completely unintended outcomes (Amin & Khoo, 2003, pp. 260).

Competency Based Medical Education (CBME) model being adopted in India as per the new Graduate Medical Education Regulations 2019, has attempted to bring about a radical change in the educational process. Undergraduate examinations in India are shifting towards a criteria-based process (Aggarwal & Agarwal., 2017; Bhattacharya et al., 2017; Mehta & Kikani, 2019). Outcome based education demands that the examinations be designed to sample and evaluate specific competencies prescribed. The success of these models strongly depended on the validity of the examination process. Summative assessments require that the assessment tool be validated. Key outcomes need to be tested (Amin & Khoo, 2003, pp. 260; McAleer, 2001). Content validity and construct validity are two very important aspect that support the effectiveness of an assessment. Content validity tests the representativeness of the learning objectives in the assessment tool and construct validity represents the congruence of the assessment tool with the intended purpose (Amin & Khoo, 2003, pp. 260).

Forensic Medicine and Toxicology in India, trains the undergraduate to apply their knowledge gained in Medicine for the benefit of law. It is a culmination of Forensic Pathology, Medical Jurisprudence and Toxicology put together. Its key objective is to empower Indian Medical Graduates in handling Medical Legal issues and critically apply their medical skills in delivering justice. Emphasis is also placed on training in etiology, identification, and management of Poisoning ( Sharma et al., 2005). Studies on student perception suggest that teaching is significantly teacher centric and theory oriented. Skill training in Medical Jurisprudence and Toxicology is significantly neglected. Students allege though they value the subject, they spend less time as only select concepts are emphasised (Gupta et al., 2017; Parmar, 2018; Sharma et al., 2005; Sudhan & Raj, 2019). As the new CBME UG curriculum 2019 is being rolled out it is necessary that deficiencies in the traditional curriculum be identified in order to deliver an efficient and effective Forensic Medicine & Toxicology curriculum (National Medical Commission, 2018).

Summative theory exams inherently have a challenge with distribution of the items being tested (Aggarwal & Agarwal, 2017;  Amin et al., 2006; Amin & Khoo, 2003, pp. 260; Bhattacharya et al., 2017). Validity of the content being tested in examination is always in question. Selecting appropriate questions, question types and domain can make all the difference in the validity of the examination (Amin et al., 2006; Amin & Khoo, 2003, pp. 260; McAleer, 2001). Particularly in Forensic Medicine which is purely application-based course, testing critical thinking and synthesis is necessary. This is found wanting in the traditional curriculum (Parmar, 2018; Sharma et al., 2005; Sudhan & Raj, 2019). Published literature on systematic analysis of summative assessment question papers in Forensic Medicine & Toxicology are sparsely available.  In this study, we have analysed and compared undergraduate summative examination question papers of Forensic Medicine & Toxicology from six reputed universities all over India for the distribution of content tested, Domain of learning and Construct of the question.

II. METHODS

A retrospective cross-sectional record-based observational study was conduct at Government Medical College, Bharatpur after obtaining ethical approval from the Institutional Ethics Committee between October to December 2020. For the study, 30 summative exam question papers from six reputed medical universities were selected based on the availability of the University question papers in public domain. The last five-year (2016-20) undergraduate question papers in Forensic Medicine & Toxicology were collected from the university websites and the college records from constituent colleges after thorough web search. The names of the universities have been kept anonymous during the analysis of results. All the data was collected form sources in public domain hence explicit consent was not taken.  Two of the selected universities were based in North India and four universities were based in South India. The identity of the Medical Universities was kept confidential during the analysis of the question papers. 

The Summative theory examination in Forensic Medicine & Toxicology as per the Medical Council of India (MCI) regulations consists of one theory paper of minimum 40 marks. The question paper consists of essay type questions and objective questions like very short answer questions or Multiple-choice questions depending on the universities (National Medical Commission, 2018).

For analysis, the questions were categorised based on the question type as LEQ (Long Essay Question), SAQ (Short Answer Question) & VSAQ (Very Short Answer Question including MCQs). The Questions were also categorised based on the domain of learning as Recall Based, Comprehension Based and Application Based Questions.

The Topics in Forensic Medicine & Toxicology can be broadly subdivided into Medical Jurisprudence, Forensic Pathology and Toxicology. These were further subdivided as Six Categories as Legal Procedure, Medical jurisprudence, Forensic Pathology, Forensic Psychiatry, Lab Technique, emerging trends, and Toxicology (Medical Council of India, 1997). Percentage of marks allotted to each of these topics was analysed in each of the papers.

Further, Forensic Pathology was Sub divided into Subtopics like Identification, Postmortem Changes, Mechanical Injuries, Mechanical Asphyxia, Thermal Deaths, Sexual Offences and Medico Legal issues related to Pregnancy, Delivery, Abortion. Toxicology was Sub divided into General Toxicology, Chemical Toxicology, Drug, Pharmacy & Substance abuse Toxicology, Bio toxicology (Medical Council of India, 1997).  Percentage allotment of Marks in each of the question papers was analysed for each of the subtopics.

The data thus collected was tabulated in an Excel Sheet and the percentage distribution of marks in various subtopics noted. The SPSS Statistical Software (IBM SPSS Statistics for Windows, Version 23.0) was used to analyse the data. Radar Graphs and line graphs were plotted to represent and compare pattern of distribution of marks in various topics in each question paper. The type of questions asked, the weightage allotted to the subtopics were compared keeping in mind the expected outcomes in the Forensic Medicine & Toxicology curriculum proposed by National Medical Commission and Medical Council of India for content validity (Medical Council of India, 1997; National Medical Commission, 2018). The learning domain targeted in the questions was compared for construct validity of the question papers.

III. RESULTS

In this study, five question papers(n=30) from each university(n=6) were analysed and compared. The data that supports the findings of this study are openly available in Figshare at https://doi.org/10.6084/m9.Fig share.19367864 (Kautilya et al., 2022).

As regulated the university Summative examination in Forensic Medicine & Toxicology consists of one theory assessment and one practical assessment (Medical Council of  India, 1997; National Medical Commission, 2018). The theory paper is allotted a minimum of 40 marks. Five universities conducted exam for 40 marks and one university paper was of 100 marks. All question papers had three types of questions, namely Essay questions (Long Answer Questions-LAQs) of 8 to 10 marks each, short essays (Short Answer questions-SAQs) of 3-5 marks each and Objective questions (like Multiple choice questions-MCQs or Very short answer questions- VSAQs) of 1-2 marks each. Table 1 presents the percentage distribution of the marks allotted to each question type.

Submitted: 19 August 2022
Accepted: 5 December 2022
Published online: 4 April, TAPS 2023, 8(2), 47-56
https://doi.org/10.29060/TAPS.2023-8-2/OA2869

Edyta Truskowska¹, Yvonne Emmett² & Allys Guerandel¹

¹Department of Psychiatry, Faculty of Medicine, University College Dublin, Ireland; ²National College of Ireland, Ireland

Abstract

Introduction: Digital Badges have emerged as an alternative credentialing mechanism in higher education. They have data embedded in them and can be displayed online. Research in education suggests that they can facilitate student motivation and engagement. The authors introduced digital badges in a Psychiatry module in an Irish University. Completion of clinical tasks during the student’s clinical placements, which were previously recorded on a paper logbook, now triggers digital badges. The hope was to increase students’ engagement with the learning and assessment requirements of the module.

Methods: The badges – gold, silver and bronze level – were acquired on completion of specific clinical tasks and an MCQ. This was done online and student progress was monitored remotely. Data was collected from the students at the end of the module using a questionnaire adapted from validated questionnaires used in educational research.

Results: The response rate was 68%. 64% of students reported that badges helped them achieve learning outcomes. 68% agreed that digital badges helped them to meet the assessment requirements. 61% thought badges helped them to understand their performance. 61% were in favour of the continuing use of badges. Qualitative comments suggested that badges should contribute to a higher proportion of the summative mark, and identified that badges helped students to structure their work.

Conclusions: The findings are in keeping with the literature in that engagement and motivation have been facilitated. Further evaluation is required but the use of badges as an educational tool is promising.

Keywords:           Medical Education, Digital Badges, Students’ Engagement, Continuous Assessment Gamification, Health Profession Education

Practice Highlights

• Digital badges may enhance student engagement.
• Digital badges may promote motivation for learning.
• Evaluation of digital badges using a questionnaire with ordinal analysis of data and coding of free comments.
• Majority of students reported working harder than in a non-gamified module.
• Digital badges provided structure and direction to the student’s learning.

I. INTRODUCTION

Educational research recognises student engagement as valuable and as having significant impact on their learning (Mandernach, 2015). While searching for tools impacting on engagement, educators observed that games have been good at engaging players for decades, through their ability to sustain players’ attention and keep them motivated throughout the games (Przybylski et al., 2010). This level of engagement is desirable to both students and educators. This achievable level of engagement in gaming strategies has led to the exploration of its use in education. Elements from game design applied in non-game contexts to influence, engage and motivate individuals and groups have resulted in the development of a new field known as gamification (Deterding et al., 2011).

Digital badges are common tools of gamification (Barata et al., 2013). They are frequently used by game designers and in recent years also by educators. A digital badge used in education can be a validated symbol of academic achievement, accomplishment, skill, quality or interest (HASTAC, n.d.). Digital badges are digital images obtained through the completion of some pre-specified goals that are annotated with metadata and that can be displayed online (Hensiek et al., 2017). In higher education badges have been used to recognise a student’s participation in a learning activity, to help students explicitly and visually capture and monitor progress made on learning tasks, to recognise the achievement of skills and competencies and to serve as a means of certifying these achievements. They are reported to have a positive effect on the learners’ motivation if they are considered as awards or if they trigger competition among peers (Yildirim et al., 2016).  

It appears that the value of digital badges depends on their design (when awarded, for what, and what they mean). For example, the use of badges as credentials only, has been criticised for focusing exclusively on extrinsic motivating factors, which have less impact on engagement than intrinsic ones (Seaborn & Fels, 2015). This is why combining the use of badges, as credentials as well as using them within the assessment process appears to be a better idea. Considering, that assessment has proven to have the most impact on effective learning, the use of badges during structured assessment has been favoured by educators (Abramovich, 2016; Rolfe & McPherson, 1995). The assessments that have potential to generate formative and summative feedback are presented as particularly useful (Armour-Thomas & Gordon, 2013). Digital Badges represent a viable alternative to existing methods of assessment in educational institutions and in the work environment (Dowling-Hetherington & Glowatz, 2017). It was also noted that access to regular feedback (broadly available in games) is helpful to learners. Students that are given opportunities to complete a task and learn from their mistakes do better in overall assessment. Games are a great example of the design where a player learns through feedback, gets better and eventually becomes successful (McGonigal, 2011). Similarly, the literature states that the use of badges has potential to offer a sort of “covert assessment”, meaning that students can approach a task as if it was a game. This helps to maintain the benefits of assessment while minimizing the potential for unhelpful levels of test anxiety (McGonigal, 2011) (Abramovich et al., 2013).

Another advantage given for the use of digital badges is their potential for remote monitoring of students’ progress and their difficulties by instructors and tutors (Huang & Soman, 2013). There is a growing momentum for the use of digital badges as an innovative instruction and credentialling strategy in higher education (Noyes et al., 2020).

In our University, Psychiatry is taught as a 10-credit module to both undergraduate and graduate entry students in the final stage of their degree in medicine. Typically, approximately 240 students are taught the module in four different groups: two groups in the spring and two groups in autumn, for six weeks at a time. Face to face teaching is centralized on Mondays and Fridays. Clinical teaching is delivered during the rest of the week and takes place in multiple different clinical centres. The overall assessment of this module comprised a continuous assessment with specific formative and summative tasks recorded in a paper logbook. The summative tasks were worth 20% of their overall assessment.

Standardising the student clinical experience, engaging them in their clinical placements and monitoring their attendance and progress can be challenging. The paper logbook/portfolio we were using was inadequate in that it did not allow for central monitoring of progress and often the difficulties students were encountering came to the attention of the teaching staff only when the logbook was handed over at the end of the module. Provision of feedback on progress was also limited. We felt that, in particular, students that were slow to progress were missing potential remediation before the summative assessments. We also encountered practical difficulties such as lost logbooks that affected the continuous assessment process.

We felt that digital badges offered a way of monitoring attendance and participation in tasks remotely, providing feedback, facilitating remediation and allowing students’ gauge how they are doing in relation to their peers while optimizing engagement in the clinical placements and structuring the learning to sustain progress through the module. We introduced and piloted the use of digital badges in the Psychiatry module as part of the continuous assessment. We carried out a descriptive study to appraise the potential usefulness of digital badges as part of our teaching strategy.

II. METHODS

A. Course Design

Students taking the 6-week Psychiatry module start their clinical placement on day 2 of the Module. Each week, students participate in their continuous assessment in order to collect their weekly badge. To acquire a badge, they need to complete and upload specific clinical tasks including formative clinical cases scheduled for them, to upload a Clinical Placement Form signed by the consultant on the team they are attached to and do an online multiple-choice question test at the end of the week. As all of this is done online their progress can be monitored remotely by the teaching team independent of the location of their clinical placement. Collecting their weekly badges provides them with 5% of their continuous assessment mark. The other marks for continuous assessment come from a summative clinical case (90%) and a reflective assignment (5%). Continuous assessment contributes to 20% of overall assessment mark.

B. Badges Design

Tutors in Psychiatry in conjunction with the University’s Teaching and Learning Department created Badges. It was part of an institution-wide digital badging pilot project (UCD Teaching and learning, 2017). It was agreed that there would be three types of badges -bronze, silver and gold – obtained and displayed on the university’s virtual learning environment (currently, Brightspace). As noted above students receive a digital badge on completion of assigned tasks, which are part of their continuous assessment. The type of badge awarded depends on the MCQ score and it is displayed on the student’s Blackboard profile. Figure 1 depicts the process. It shows that all badges are contributing to 5% of the module continuous assessment. Every week students receive information as to what percentage of the group has acquired a bronze, silver or gold badge so they have an idea of their performance in relation to that of the rest of the group.

Figure 1. Step-by-step the process of getting/awarding a badge

C. Questionnaire

The ‘Digital Badges Experience Survey’ questionnaire was designed based on previously described surveys: the ARCS Badge Motivation Survey (Foli et al., 2016) and the Badge Opinion Survey (Abramovich et al., 2013) with some additional questions suggested by the literature on digital badges. The authors and faculty members identified and agreed on the following constructs as being relevant to our teaching delivery and our study: previous knowledge of digital badges (items 1 & 2), their meaning and relevance to students (items 22, 13, 14, 12, 8 & 5) motivation and engagement (items 3, 4 & 23), relevance to assessment and feedback (items 11, 9, 10, 24, 18 & 19), their use in structuring learning (items 15, 6, 7 & 16), self-efficacy (items 17, 20, 21 & 25), social context implication (items 26, 27 & 28). Under each construct, items from the above questionnaires were discussed and agreement reached on the ones to be used, altered or added assessing relevance and acceptability for our aims and teaching context.

Our survey consisted of 30 items with answers displayed on a seven-point Likert Scale. The 31^st (final) question required dichotomous (yes/no) answer with space for respondents to explain their reasons for it. We also provided for free commenting from students (Questionnaire is available in Table 1).

Please rate your agreement with each of the statements using the following scale:

Strongly Agree	Agree	Somewhat Agree	Neutral	Somewhat Disagree		Disagree	Strongly Disagree
+3	+2	+1	0	– 1		-2	-3
Please circle one number for each statement					Strongly Agree			Strongly Disagree

1. I knew what digital badges were before I began this module.	+3	+2	+1	0		-1	-2	-3
2. I have earned digital badges before beginning this module.	+3	+2	+1	0		-1	-2	-3
3. I felt motivated to complete the module because I was earning digital badges.	+3	+2	+1	0		-1	-2	-3
4. Compared to other modules on my programme, the digital badges motivated me to work harder.	+3	+2	+1	0		-1	-2	-3
5. The digital badges helped me to understand the learning outcomes for this module.	+3	+2	+1	0		-1	-2	-3
6. The digital badges helped me to achieve the learning outcomes for this module.	+3	+2	+1	0		-1	-2	-3
7. The badge helped draw my attention to the clinical seminars.	+3	+2	+1	0		-1	-2	-3
8. The digital badges helped me to understand the content of this module.	+3	+2	+1	0		-1	-2	-3
9. The digital badges helped me to understand the assessment requirements for this module.	+3	+2	+1	0		-1	-2	-3
10. I was more aware of the module continuous assessment requirements because I would be earning digital badges.	+3	+2	+1	0		-1	-2	-3
11. Because I was earning digital badges, I knew the continuous assessment requirements were important.	+3	+2	+1	0		-1	-2	-3
12. Earning digital badges made a difference in how I viewed completing the continuous assessment requirements.	+3	+2	+1	0		-1	-2	-3
13. Earning badges made the assignments more significant to me.	+3	+2	+1	0		-1	-2	-3
14. The badges increased how relevant the assignments were.	+3	+2	+1	0		-1	-2	-3
15. The digital badges helped me to structure my work in this module.	+3	+2	+1	0		-1	-2	-3
16. The digital badges helped me to meet the assessment requirements of this module.	+3	+2	+1	0		-1	-2	-3
17. The badges increased my confidence that I could demonstrate the content of my knowledge.	+3	+2	+1	0		-1	-2	-3
18. The digital badges helped me to understand my performance in this module.	+3	+2	+1	0		-1	-2	-3
19. The digital badges helped me to understand my progress through the module.	+3	+2	+1	0		-1	-2	-3
20. The badges were symbols that I had mastered content.	+3	+2	+1	0		-1	-2	-3
21. The badges increased my overall level of satisfaction with completing the continuous assessment requirements.	+3	+2	+1	0		-1	-2	-3
22. By earning the badges I was more fulfilled as a student by completing the assessment requirements.	+3	+2	+1	0		-1	-2	-3
23. The digital badges made me want to keep on working.	+3	+2	+1	0		-1	-2	-3
24. I understand why I earned all of my badges.	+3	+2	+1	0		-1	-2	-3
25. The badges I earned represent what I learned on this module.	+3	+2	+1	0		-1	-2	-3
26. I talked to others about the badges I earned.	+3	+2	+1	0		-1	-2	-3
27. I compared the badges I earned with others’ on the module.	+3	+2	+1	0		-1	-2	-3
28. The potential to earn digital badges at gold, silver and bronze levels made me feel competitive.	+3	+2	+1	0		-1	-2	-3
29. I think digital badges are a good addition to the programme.	+3	+2	+1	0		-1	-2	-3
30. I would like to earn digital badges in other modules on my programme.	+3	+2	+1	0		-1	-2	-3
31. I think the badges are helpful and should be used in the coming years: tick as appropriate and give 3 reasons why	Yes ☐				No ☐
32. Any other comments

Thank you for your participation

Table 1. Digital Badges Experience Survey

D. Participants

The questionnaires were distributed to all the students of final year of Medicine in our university at the beginning of the final or sixth week of the module and collected by their tutors. Informed verbal consent was obtained from study participants. As described above, the course was run four times in one academic year, and we collected data from all four groups of students: two in the spring and two in the autumn.

E. Data Collection and Analysis

As noted above, questionnaires were distributed and collected by tutors at the beginning of the sixth (last) week of the Psychiatry Course. The level of student’s agreement with various statements was marked on the 7-point Likert-type scale. Those data were uploaded to Excel. Data from Likert scales can be analysed as ordinal as well as interval data (Sullivan & Artino 2013), (Norman, G. 2010) and we have considered both options. We concluded that using descriptive statistics such as the mean in relation to students’ opinions had limited value (Sullivan & Artino 2013), (Knapp 1990). This is why we decided to analyse our data as ordinal. To simplify the answers, we organised them into three groups: “agreed”, “neutral”, “disagreed”.

Students’ comments were entered into an excel sheet and analysed by two independent researchers. The comments relating to the use of badges in teaching of Psychiatry were coded according to topics, which were identified and agreed upon by the two independent researchers (Johnson & LaMontagne, 1993), (Sundler et al., 2019). Topics were further codified as positive or negative. This way of coding is described and performed in more details in other studies (Quesenberry et al., 2011).

III. RESULTS

A. Demographics

161 out of 237 students completed questionnaires giving a 68% response rate. The response rate was 75% in the first half (from springtime) of the students and 61% in the second (autumn rotation).

B. Analysis of Answers

65% of students had no previous knowledge of digital badges and 93% had never earned a badge before the module as per items 1 & 2 of questionnaire.

1) Meaning and relevance: Item 22: 48% of respondents agreed that by earning the badges they felt more fulfilled as a student when completing the assessment requirements. 31% disagreed. 45% agreed and 39% disagreed that earning badges made the assignments more significant to them (item 13) and similarly only 42% felt the badges increased the sense of how relevant the assignments were, while 40 % disagreed with this view as per item 14.

Earning digital badges made a difference in how 59% of students viewed completing the continuous assessment requirements, (item 12). 29% disagreed with this. 68% students felt that the digital badges helped them to understand the content of this module and 18% disagreed, (item 8). 66% students agreed and 24% disagreed about the fact that digital badges helped them to understand the learning outcomes for this module (item 5).

2) Motivation and engagement: 51% of students that responded felt motivated to complete the module because they earned a digital badge (item 3). 33% did not agree with this. The possibility of earning a digital badge motivated 43% of respondents to work harder (item 4). 39% disagreed with this. The digital badges made 45% of students want to keep on working, while 29% were not impacted (item 23).

3) Assessment and feedback: Item 11: 50% felt that because they were earning digital badges, they knew that the continuous assessment requirements were important. 36% disagreed. The digital badges also helped 69% respondents to understand the assessment requirements for this module but not so for the 15% respondents (item 9). Out of all respondents, 78% were more aware of the module continuous assessment requirements because of the digital badges, and only 15% disagreed with that (item 10). Item 24: As many as 74% of all respondents did and 14% did not understand why they earned their badges. The digital badges helped 61% of students to understand their performance in this module (item18). 27% did not find that badges helped in that way. Similarly, the digital badges helped 61% of students to understand their progress through the module. 22% disagreed with this (item 19).

4) Structure: Out of all respondents 50% agreed and 33% disagreed that the digital badges helped them to structure their work in the module (item 15). 64% of respondents agreed and 21% disagreed that the digital badges helped them to achieve the learning outcomes for this module (item 6). Similarly, the badge helped draw attention to the clinical seminars for 57% of respondents, but not so for 25%. 68% of students (vs 19% who have disagreed) felt that the digital badges helped them to meet the assessment requirements of this module (item 16).

5) Self-efficacy: Item 17: 48% of students agreed (vs 33% who disagreed) that earning the digital badges made them more confident that they could demonstrate the content of their knowledge. Item 20: 41% of all respondents agreed that the badges were symbols of mastering the content of the module. A similar number (40%) of students disagreed and 17% stayed neutral. 59% found the badges increased their overall level of satisfaction with completing the continuous assessment requirements (item 21). 27% disagreed with this. 44% of students agreed and 41% disagreed with the statement that the badges they earned represented their learning in the module (item 25).

6) Social context and competitiveness: 42% of students did and 44% did not talk to others about the badges they earned (item 26). The potential to earn digital badges at gold, silver and bronze levels made 49% of students more competitive (item 28). 39% disagreed with this. 29% of students did and 56% did not compare the badges they earned with others on the module (item 27).

7) Overall: 56% agreed that digital badges were a good addition to the program. 61% of students found digital badges helpful and felt that they should be used in the future. 31% did not agree with the statement and 8% did not answer.

Students’ opinions: 136 students did and 25 students did not write any comment. Students’ comments related either to one or to several topics. Students were positive about the use of badges (in various topics) 134 times (See Figure 1) and negative/critical 106 times (See Figure 2). It is important to note however that as many as 67 out of the 106 negative comments related to the low value of the badges.

Figure 2 depicts information about positive topics included in students’ comments. 50 students liked the structure and focus that the badge system provided. Twenty-eight students found badges motivating and 24 valued feedback they received in the process. A number of students found the whole process enjoyable, rewarding and fun (See Figure 2). Figure 3 indicates the negative opinions. The most frequent topic of all was repeated 67 times as was related to the value of badges (See Figure 3). Figure 4 shows some comments made by students in the free comment box provided on the survey (See Figure 4).

Figure 2. Frequency of positive comment grouped by topic

Figure 3. Frequency of negative comment grouped by topic

Figure 4. Comments written by students

In summary, the majority of the students liked the way Digital Badges were used in the teaching of Psychiatry, however both groups (those that liked and those that dislike badges) criticized them for their low value of the overall assessment.

IV. DISCUSSION

Students met digital Badges piloted in the teaching of Psychiatry to Medical Students of our university originally with apprehension. The majority of the students had never heard of digital badges and have never earned a digital badge before this module. However, data from the study looking at students’ perception of the use of digital badges in medical education provided encouraging results.

A. Sense of Reward

Students found badges rewarding yet complained about the small value of the badges. This reflected our design intention in which we wanted to support and engage students rather than focus on extrinsic motivating factors such as sense of reward.

As mentioned above the badge was awarded for completion of weekly tasks, and the acquisition of a badge was functioning more as a method of feedback to students rather than for grading. However, a number of students complained about this, and reported a sense of frustration and a lack of motivation to try harder when the assessment value of the badge was so low.

Nevertheless, our design was supported by other studies. One such study concluded that achievement of badges could influence students’ behaviour even if they do not interfere with grading (Hakulinen & Auvinen, 2014). It seems that competitiveness was triggered in those who wanted to do better anyway.

We were pleased to see learners’ comments about reduced stress during the module. We wanted our award system to potentiate a sense of safety around assessment, giving participants freedom to learn from their mistakes without influencing their final grade. This is a well-recognized principle in gamification as a facilitator of students’ engagement (De Byl & Hooper, 2013).

In addition, our design was guided by the fact that the best use of badges was linked with the recognition of already occurred learning, therefore more viewed as an assessment tool, providing feedback and possibly self-reflection (Reid et al., 2015).

B. Impact on Structure, Assessment and Feedback

We were pleased to note that students in our study felt that digital badges provided direction and structure to their learning. This was also reflected in their comments: students mentioned how badges impacted on their study structure, helping them to focus attention on important aspects of the seminars. These findings are consistent with a study that reported that students who enjoyed badges, found them helpful in giving them the direction they needed to work in (Abramovich et al., 2013). These students also praised the alignment between badge topics and course content (Abramovich et al., 2013).

We were also hoping that badges designed, as part of an assessment that generates formative feedback would help students know if they are progressing enough to meet the requirements of their class (HASTAC n.d.). Based on responses to items 24, 18 and 19 it appeared that students benefited somewhat from the potential guidance and feedback provided by the digital badges system.

It is important to remember that students were asked about the badges at their review seminar and few days prior to their exams. This timing could have influenced their answers. For example, students’ opinion was divided on the statement that earning a badge gave them a sense that they have mastered the course content. Similarly, opinion was divided on whether badges increased students’ confidence that they could demonstrate their knowledge, nevertheless more students felt that they had an impact. It would be interesting to see if students’ responses had been different after their exams. We know gamification has already been described as a powerful strategy that can help achieve learning objectives by affecting the way students behave (Huang & Soman, 2013).

C. Impact on Motivation and Engagement

In our study, a majority of students responded that they worked harder in this module compared to non-gamified modules. Similarly, about 30% more students stated that they were more motivated to work harder through the module because they were earning digital badges. Interestingly when they were given space to provide free comment, many have noted that they did feel more motivated, and a few felt more engaged. Previous studies also reported that students were more likely to engage in the game-like tasks providing rapid feedback (Thamvichai & Supanakorn-Davila, 2012). In other publications students also considered gamified courses to be more motivating, interesting and easier to learn as compared to other courses (Barata et al., 2013), (Dicheva et al., 2015), (Hakulinen & Auvinen, 2014). It is suggested that badges are most valued by learners who are extrinsically motivated and value external validation (Foli et al., 2016).

D. Impact on Outcomes

We did not compare outcomes in overall performance in assessment between students before and after implementation of badges. Having considered this, we decided against it. We felt there were too many variables influencing students’ performance and it would be difficult to definitely attribute potential change to the implementation of digital badges.

E. View of Badges and Learner Type

The impact of an educational tool could also depend on characteristics of the student as a learner. It is reported that students with high expectation for learning and those that value their learning tasks may view the badge as validating if designed as a performance assessment (having impact on intrinsic motivation), but it may devalue their learning if it was viewed as an external reward (Reid et al., 2015). On the other hand, badges used as an assessment model can have a negative impact on students with low expectancy values (Reid et al., 2015). Another study concluded that engagement in the gamified classroom was dependent on students’ playfulness (De Byl & Hooper, 2013). In this study, we have not addressed the learner types and other such specifications of the individuals in our group of students.

In a systematic review of digital badges in health care education, it is mentioned that digital badges represent an innovative approach to learning and assessment and evidence in further education literature demonstrates that their use increases knowledge, retention and motivation to learn. However, they also report a lack of empirical research investigating digital badges within the health care education context (Noyes et al., 2020).

F. Limitations

Our study is limited by the lack of demographic data from all participants. This reduces the potential for comparison between genders and undergraduate vs postgraduate students. As mentioned above, we have not addressed learner characteristics and types (intrinsic versus extrinsic motivation, playfulness). The timing of the data collection (students completed questionnaires before their exams, rather than after) may also be limiting factors. It is also important to remember that this study allowed only for assessment of subjective impact (via students’ opinions and experience) of the badges on students learning and did not perform objective measures of students’ overall performance.

V. CONCLUSION

This study was performed at the start of the implementation of the digital badges in the module and at the time, it was the only module with elements of gamification throughout the whole undergraduate medical curriculum in our university. Like most changes in the assessment process, the students greeted this with a level of apprehension. It would be interesting to see if students’ opinion has evolved after a few years of digital badges being integrated in the module and when other modules are using them. Nevertheless, our data shows that our group of students felt, that they benefited from the learning structure provided by the digital badges. The online process of obtaining the badges enabled tutors to provide timely feedback and monitor students’ progress. In addition, our findings are in keeping with the literature in that engagement and motivation have been facilitated by introducing the digital badges and as such, they indicate that the use of digital badges is a promising tool in education.

The use of digital badges in Medical Education is only starting and would benefit from more research in its judicious integration in higher education curriculum as appropriate.

Notes on Contributors

Dr Edyta Truszkowska did the literature search, collected and analysed the data and gave feedback on methodology and questionaire developed and wrote paper.

Dr Yvonne Emmett designed the methodology and developed questionaire. She gave feedback on the data analysis and edited the writing of the paper.

Prof Allys Guerandel suggested the implementation of digital badges and research project. She gave feedback on data analysis and wrting of paper making revisions to same.

All three authors have read and approved the final manuscript.

Ethical Approval

Our project has been exempted by ethics committee of our institution Human Research Ethics Committee – Sciences (Exemption number LS-E-17-56).

Data Availability

Data is available on reasonable request and data is shared in the institution.

Acknowledgement

We would like to acknowledge our institution psychiatry teaching team for their support in the implementation of the digital badges.

Funding

There are no sources of funding.

Declaration of Interest

 There is no conflict of interest for any of the authors.

References

Abramovich, S. (2016). Understanding digital badges in higher education through assessment. On the Horizon, 24(1), 126-131. https://doi.org/10.1108/OTH-08-2015-0044

Abramovich, S., Schunn, C., & Higashi, R. M. (2013). Are badges useful in education? It depends upon the type of badge and expertise of learner. Educational Technology Research and Development, 61(2), 217-232. https://doi.org/10.1007/s11423-013-9289-2

Armour-Thomas, E., & Gordon, E. (2013). Toward an Understanding of Assessment as a Dynamic Component of Pedagogy. https://www.ets.org/Media/Research/pdf/armour_thomas_gordon_understanding_assessment.pdf

Barata, G., Gama, S., Jorge, J., & Gonçalves, D. (2013, September). Engaging engineering students with gamification. In 2013 5th International Conference on Games and Virtual Worlds for Serious Applications IEEE, UK (VS-GAMES) (pp. 1-8). https://doi.org/10.1109/VS-GAMES.2013.6624228

De Byl, P., & Hooper, J. (2013). Key attributes of engagement in a gamified learning environment. In ASCILITE-Australian Society for Computers in Learning in Tertiary Education Annual Conference, Australia (221-230). https://www.learntechlib.org/p/171232/

Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011, September). From game design elements to gamefulness: defining” gamification”. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9-15). https://doi.org/10.1145/2181037.2181040

Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Journal of Educational Technology & Society, 18(3), 75-88. https://www.jstor.org/stable/jeductechsoci.18.3.75

Dowling-Hetherington, L., & Glowatz, M. (2017). The usefulness of digital badges in higher education: Exploring the student perspectives. Irish Journal of Academic Practice, 6(1), 1-28. https://researchrepository.ucd.ie/handle/10197/9691

Foli, K. J., Karagory, P., & Kirby, K. (2016). An exploratory study of undergraduate nursing students’ perceptions of digital badges. Journal of Nursing Education, 55(11), 640-644. https://doi.org/10.3928/01484834-20161011-06

Hakulinen, L., & Auvinen, T. (2014, April). The effect of gamification on students with different achievement goal orientations. In 2014 international conference on teaching and learning in computing and engineering, Malaysia (pp. 9-16). IEEE. https://doi.org/10.1109/LaTiCE.2014.10

HASTAC. (n.d.). Digital Badges. http://www.hastac.org/digital-badges

Hensiek, S., DeKorver, B. K., Harwood, C. J., Fish, J., O’Shea, K., & Towns, M. (2017). Digital badges in science: A novel approach to the assessment of student learning. Journal of College Science Teaching, 46(3), 28. https://www.proquest.com/scholarly-journals/digital-badges-science-novel-approach-assessment/docview/1854234735/se-2

Huang, W. H. Y., & Soman, D. (2013). Gamification of education. Report Series: Behavioural Economics in Action, 29, 11 -12.

Johnson, L. J., & LaMontagne, M. J. (1993). Research methods using content analysis to examine the verbal or written communication of stakeholders within early intervention. Journal of Early Intervention, 17(1), 73-79.

Knapp, T. R. (1990). Treating ordinal scales as interval scales: An attempt to resolve the controversy. Nursing Research, 39(2), 121-123.

Mandernach, B. J. (2015). Assessment of student engagement in higher education: A synthesis of literature and assessment tools. International Journal of Learning, Teaching and Educational Research, 12(2), 1-14.

McGonigal, J. (2011). Reality is broken: Why games make us better and how they can change the world. Penguin.

Norman, G. (2010). Likert scales, levels of measurement and the “laws” of statistics. Advances in health sciences education, 15(5), 625-632.

Noyes, J. A., Welch, P. A., Johnson, J. W., & Carbonneau, K. J. (2020). A systematic review of digital badges in health care education Medical Education, 54(7), 600-615. https://doi.org/10.1111/medu.14060

Przybylski, A. K., Rigby, C. S., & Ryan, R. M. (2010). A motivational model of video game engagement. Review of General Psychology, 14(2), 154. https://doi.org/10.1037/a0019440

Quesenberry, A. C., Hemmeter, M. L., & Ostrosky, M. M. (2011). Addressing challenging behaviors in Head Start: A closer look at program policies and procedures. Topics in Early Childhood Special Education, 30(4), 209-220. https://doi.org/10.1177/0271121410371985

Reid, A. J., Paster, D., & Abramovich, S. (2015). Digital Badges in undergraduate composition courses: effects on intrinsic motivation. Journal of Computers in Education, 2(4), 377-98. https://doi.org/10.1007/s40692-015-0042-1

Rolfe, I., & McPherson, J. (1995). Formative assessment: How am I doing? The Lancet, 345(8953), 837-839. https://doi.org/10.1016/S0140-6736(95)92968-1

Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human Computer Studies, 1(74), 14-31. https://doi.org/10.1016/j.ijhcs.2014.09.006

Sullivan, G. M., & Artino, A. R. (2013). Analyzing and interpreting data from likert-type scales. Journal of Graduate Medical Education, 5(4), 541-542 https://doi.org/10.4300/JGME-5-4-18

Sundler, A. J., Lindberg, E., Nilssonn, C., & Palmer, L. (2019). Qualitative thematic analysis based on descriptive phenomenology. Nursing Open, 6(3), 733-739. https://doi.org/10.1002/nop2.275

Thamvichai, R., & Supanakorn-Davila, S. (2012). A pilot study: Motivating students to engage in programming using game-like instruction. Proceedings of Active Learning in Engineering Education. St Cloud University. https://nms.asee.org/wp-content/uploads/sites/47/2020/02/St_Cloud_2012_Conference_Proceedings.pdf#page=18

UCD Teaching and learning. (2017). UCD digital/open badges pilot 2016/2017. Implementation and evaluation report. UCD Teaching and Learning, 1-23. https://www.ucd.ie/t4cms/UCD%20Digital%20Badges%20Pilot%20Report.pdf

Yildirim, S., Kaban, A., Yildirim, G., & Celik, E. (2016). The effect of digital badges specialization level of the subject on the achievement, satisfaction and motivation levels of the students. Turkish Online Journal of Educational Technology- TOJET, 15(3), 169-182. https://eric.ed.gov/?id=EJ1106420

*Allys Guerandel
University College Dublin,
School of Medicine and Medical Sciences,
Belfield, Dublin 4, Ireland D04V1W8.
00353868590063
Email: allys.guerandel@ucd.ie

Submitted: 1 August 2022
Accepted: 1 November 2022
Published online: 4 April, TAPS 2023, 8(2), 36-46
https://doi.org/10.29060/TAPS.2023-8-2/OA2855

Marina C. Jenkins¹, Caroline R. Paul², Shobhina Chheda¹ & Janice L. Hanson³

¹School of Medicine and Public Health, University of Wisconsin-Madison, United States; ²Langone Health, Grossman School of Medicine, New York University, United States; ³School of Medicine, Washington University in St. Louis, United States

Abstract

Introduction: Increases in vaccine hesitancy continue to threaten the landscape of public health. Literature provides recommendations for vaccine communication and highlights the importance of patient trust, yet few studies have examined medical student perspectives on vaccine hesitancy in clinical settings. Therefore, we aimed to explore medical student experiences encountering vaccine hesitancy, mistrust, and personal biases, with the goal of informing medical student education.

Methods: A health disparities course including simulated clinical scenarios required students to complete a written reflection. We sorted reflections written in 2014-2016 to identify common topics and used inductive thematic analysis to identify themes relevant to vaccine hesitancy by group consensus.

Results: Our sample included 84 de-identified essays sorted into three non-exclusive topics: vaccine hesitancy (n=42), mistrust (n=34), and personal bias (n=39). We identified four themes within medical students’ reflections: 1) Building a Relationship, including emphasis on patient-centred approaches; 2) Preparedness and Need to Prepare for Future Encounters, including highlighting gaps in medical education; 3) Reactions to Encountering Hesitant Patients, including frustration; 4) Insights for Providing Information and Developing a Plan with Hesitant Patients, including approaches to presenting knowledge. 

Conclusion: Reflections in the context of simulated encounters and discussion are useful in students identifying their preparedness for vaccine discussion with patients. Student reflections can assist educators in identifying missing educational frameworks for particular scenarios such as vaccine hesitancy. Without a structured framework regarding addressing vaccine hesitancy, students draw upon other skills that may contradict recommended practices.

Keywords:           Medical Education, Vaccine Hesitancy, Reflective Writing, Bias, Mistrust

Practice Highlights

• Reflective writing can be a useful tool in medical education toward addressing vaccine hesitancy.
• Medical student reflective writing can be used to demonstrate curricular gaps.
• Medical students expressed feeling unprepared to care for vaccine hesitant patients.
• Without a framework for vaccine communication, students may draw on other inappropriate skills.

I. INTRODUCTION

Increases in vaccine hesitancy and refusal threaten public health (He et al., 2022; Hough-Telford et al., 2016; Kempe et al., 2020; Santibanez et al., 2020), especially with the COVID-19 pandemic introducing a need for quick and widespread uptake of a new vaccine (Hamel et al., 2022; Ognyanova et al., 2022). Patients, especially parents, are increasingly seeking alternative forms of health information, such as online sources that can include misinformation (Broniatowski et al., 2018; Hara & Sanfilippo, 2016; Jenkins & Moreno, 2020; Meleo-Erwin et al., 2017). Patient trust in their clinician and the health care system delivering the vaccine strongly influence vaccination decisions (Goldenberg, 2016; Kennedy et al., 2011; Larson, 2016). Trust remains the most important barrier to acceptance and uptake of the COVID-19 vaccine, with mistrust of government, medicine, and science presenting major barriers to vaccine uptake (Ognyanova et al., 2022). Vaccine hesitant patients may bring preconceptions and concerns from their own research to in-clinic vaccine communication. Thus, it is important for clinicians to be well-prepared to work with vaccine-hesitant patients and parents.

Existing recommendations for clinicians encountering vaccine hesitancy emphasise centring patient views and voice instead of a medical, academic perspective (Holt et al., 2016; Koski et al., 2019). Approaches including motivational interviewing, presumptive language around vaccine recommendations, and persistent vaccine reminders without pressuring or dismissing patients have been shown to be effective in addressing vaccine hesitancy in medical practice (Dempsey et al., 2018; Gagneur et al., 2018; Hofstetter et al., 2017), while correcting misinformation and offering evidence to patients have been found to be counterproductive (Holt et al., 2016; Koski et al., 2019). These pre-COVID recommendations remain the same for addressing COVID-19 vaccine hesitancy, and lack of physician preparedness for encountering these patients is still an important issue (Centres for Disease Control and Prevention, 2021). Physicians may have misconceptions about patients’ reasons for vaccine hesitancy, often assuming lack of understanding or information on the safety, effectiveness, and necessity of vaccines (Hough-Telford et al., 2016), rather than recognising the more central roles of trust and validation of concerns. If physicians do not learn approaches for centring patient voices in vaccine communication, these pre-conceived biases may present a barrier to vaccine uptake and patient-physician trust.

While valuable recommendations for addressing vaccine hesitancy in the clinical setting exist, current efforts center around informing practicing clinicians on these approaches and providing more educational resources to patients (Centres for Disease Control and Prevention, 2021). These may not represent a sufficient, long-term solution. Furthermore, resources available for healthcare workers may be inaccessible or overwhelming for physicians independently seeking tools (Karras et al., 2019). Incorporating vaccine hesitancy-centred curriculum into medical education may be the optimal, long-term solution to the lack of physician preparedness for these encounters, especially in the face of future pandemics and introduction of new vaccines. With curriculum renewal efforts incorporating early clinical experiences, students could encounter patients for whom vaccines are recommended, including vaccine hesitant patients, early in medical school. It would provide a better educational experience for students and a better health care experience for patients if students receive education to prepare them for these conversations. However, few studies have examined medical student perspectives on vaccine hesitancy in the clinical setting. Existing studies have found mixed findings around medical students’ reflections on their preparedness for encountering vaccine hesitant patients and highlight the need for expansion of related curriculum in medical education (Brown et al., 2017; Kernéis et al., 2017). While COVID vaccine hesitancy literature lacks exploration of medical student perspectives and preparedness, recent studies have highlighted an additional barrier of vaccine hesitancy among medical students in some settings (Lucia et al., 2021). These findings provide additional motivation for including vaccine hesitancy-specific curriculum in medical education.

Understanding medical students’ reactions to vaccine hesitancy is critical in preparing students to address vaccine hesitancy while maintaining patient trust. In the present study, which used a scholarship-of-teaching approach, we aimed to expand on existing research on medical student preparedness for encountering vaccine hesitancy to examine written reflections on mistrust and personal bias in clinical encounters more broadly and use a larger sample of student narratives. We analysed students’ structured reflections regarding assigned reading, simulated patient encounters, peer discussions, and faculty-facilitated discussions to evaluate medical students’ learning during a health disparities curriculum. Structured reflection on simulated encounters has been shown to be a useful tool for understanding student perspectives (Koski et al., 2018); this approach can inform development of medical curriculum for addressing vaccine hesitancy and may be a useful teaching tool as well for students to practice, discuss, and reflect on their own biases in an educational setting. Therefore, the purpose of this study was to explore medical student reflections on encountering vaccine hesitancy, patient mistrust, and personal biases, with the goal of informing medical student education.

II. METHODS

In this qualitative study, we analysed written reflections from a third-year medical student Skills to Impact Health Disparities course, to evaluate their learning about interacting with vaccine-hesitant patients and parents. This study was determined to be exempt by the relevant institutional review boards, including a waiver of informed consent.

From 2006-2018, a medical school at a U.S., Midwestern university required a one-day core session with the goal of developing learner skills to impact health disparities. Small groups of approximately six students went through five to six standardized patient scenarios, each designed to generate discussion and reflection about clinician bias that can unintentionally influence patient care. During the learning activity, each student spent 3-5 minutes interacting with a standardized patient who presented a challenge designed to provoke a level of discomfort in the learners to allow for discussion and reflection. One of these six scenarios included a parent with a history of vaccine refusal for their child expressing concerns about a recommended vaccine.

Following each case, students engaged in a 15-minute, non-facilitated discussion based on a list of focused questions. After all cases, students joined another group of six students for a 75-minute faculty-facilitated debrief. In addition, students were required to complete a brief critical reflection based on a theme of the core day activity using the LeAP framework (Aronson et al., 2012). This framework is modelled on a clinical framework, the SOAP note (Chief complaint, Subjective, Objective, Assessment, and Plan). Students were asked to consider a specific experience that led to concern or questions; describe the experience as fully as possible; reconsider the experience by getting other perspectives; synthesize learning; and make a plan to address future similar challenges. Students could choose to reflect on simulated or real clinical experiences.

Written reflective essays were available for analysis from years 2014-2016, providing qualitative data about students’ observations and experiences with health disparities and health equity. All available essays (n=292) from 2014, 2015, and 2016 that were submitted as a course requirement for the Skills to Impact Health Disparities Core Day required course were de-identified and organized by year.

To ascertain the topics that the students addressed, three investigators (two involved in this study and one from another study using the larger set of all essays) read all essays. Each investigator then designated each essay to a topic from a jointly-developed list of non-exclusive topics derived from the data. After individually assigning topics for a sample of essays, the investigators met to compare their sorting and reconcile any differences before they went on to sort through another set of essays. This process continued until all essays were assigned to one or more topics. Most topic labels matched topics of the simulated scenarios that the students encountered in the course, while others related to broader issues highlighted across scenarios. With the goal of selecting reflections relevant to the issue of vaccine hesitancy, all reflections designated under the topics of vaccine hesitancy, mistrust, and personal bias were gathered for qualitative data analysis. Literature review and initial reading of essays suggested essays on encountering mistrust and bias relate to students’ experiences when encountering vaccine hesitant patients, despite not all essays relating directly to vaccine hesitancy. Each essay was assigned an identifier with cohort year and an essay number. Individual essays were excluded based on group consensus on lack of relevance to vaccine hesitancy.

Inductive thematic analysis was used to identify codes and themes in the reflection data using a semantic, realist approach to identify explicit reactions from students grounded in clinical experiences to identify themes that could be directly applied to clinical practice (Braun & Clarke, 2006). Four investigators, including two involved in topic assignment (CRP, SC) and two additional investigators (MCJ, JLH), read and discussed six essays to develop a preliminary codebook, applied these codes to the same six essays, then met to discuss and revise the codebook. Subsequently, investigators coded the remaining essays in pairs using the revised codebook through four rounds of coding, making further iterative changes to the codebook and reconciling differences within pairs. The full team then met to discuss the coding, revise code descriptions, refine the grouping of the codes, and agree on descriptions of the groups. Any changes made to the codebook during the analysis process were retrospectively updated in all previous coding, so that all coding data reflected the final version of the codebook. Data were organized with qualitative analysis software (HyperResearch version 4.5.4). After all data were coded, investigators discussed and reached consensus on the themes.

III. RESULTS

A total of 90 reflections were collected from the Skills to Impact Health Disparities course across three cohorts of third-year medical students from 2014-2016 at one U.S., Midwestern university. Based on investigator consensus on lack of content relevance, six reflections were excluded from our study sample. Our final study sample included 84 de-identified reflections across three, non-exclusive topics: 42 categorized as relating to vaccine hesitancy, 34 as mistrust, and 39 as personal bias. We identified four major themes in medical students’ reflections on encountering vaccine hesitancy, mistrust and personal bias: 1) Building a Relationship, 2) Preparedness and Need to Prepare for Future Encounters, 3) Reactions to Encountering Hesitant Patients, and 4) Insights for Providing Information and Developing a Plan with Hesitant Patients. Representative quotes for each theme can be found in Table 1. Supplemental Table 1 lists each theme with the codes that informed the theme.

A. Building a Relationship

In our first theme, medical students recognized the importance of Building a Relationship with hesitant parents or patients as the foundation for discussions about vaccines or other care about which patients expressed hesitance. They focused on approaches such as building rapport, centring the parent/patient’s views during the discussion, acknowledging their efforts to gather information about their health decisions, expressing empathy, and avoiding direct confrontation of the patient’s viewpoint during the discussion. Many of these observations occurred during the core day experience. For example, one student wrote:

“I learned the importance of letting the patient try to teach the doctor what they know rather than the doctor jumping in and lecturing to the patient. In the future I will try to talk less and let the patient explain more about why they oppose vaccinations to better gauge what they understand about the literature before I try to explain why vaccinations are important and the facts about vaccinations.”

[Year3_61]

The students saw the importance of finding points of commonality between their perspectives and those of the patient and moving the conversation toward establishing goals that they could work together with the patient to accomplish.

One student described, “I learned that a big part of approaching this difficult conversation is establishing the correct approach: common goal, shared decision making.”

[Year3_65]

B. Preparedness and Need to Prepare for Future Encounters

Another major theme identified in medical student reflections on encountering hesitant patients was Preparedness and Need to Prepare for Future Encounters. This theme included discussion of whether the student expressed feeling ready for the encounter or whether they thought it was successful, as well as specific plans for preparing for similar encounters in the future. One way that students discussed their own feelings of preparedness was by recognizing their own biases upon reflection of the encounter. For example, one student wrote:

“I realized my own prejudices influenced my care of my patients more than I would have liked. … It was an eye opener that I am not as impartial as I would like to be and that it takes a lot more self-reflection and awareness to be the best care provider I can be.

[Year3_16] 

When discussing a need to prepare for future encounters, many students referenced plans to independently seek additional resources, especially those referenced by patients in encounters.

Other students mentioned plans to practice patient interactions related to the reflection encounter; including, “For me, practicing acknowledging a patient’s views and concerns without endorsing or validating false information is paramount.”

[Year1_07]

Some students also referenced plans to request feedback or advice from more senior clinicians. Additionally, several students identified gaps in their medical school curriculum that contributed to their lack of preparedness or that needed to be filled to support future preparedness. Students specifically referred to needing more resources, support, and training for encountering hesitant patients. They sometimes called for system-wide changes to address this gap in knowledge.

C. Reactions to Encountering Hesitant Patients

One of the themes identified in the students’ self-reflection was related to their own and others’ Reactions to Encountering Hesitant Patients. While some students expressed frustration with patients/parents who expressed hesitance about vaccines, they acknowledged that they can be passionate about the topic of vaccines in their patient care, but ultimately, patients and parents make their own decisions.

One student shared, “I have always found it quite distressing when an otherwise healthy child goes unvaccinated, given the enormous amount of evidence in favour of vaccination efficacy and its effect on public health.”

[Year2_86]

Another student shared, “I knew I could not force the patient, and I knew that she ultimately was in control of what she would do.”

[Year3_78]

In some reflections patient and parents were labelled, for example, as “anti-vaxxers.” Some reflections described parents’ and patients’ bias towards the physician or clear messaging of a desire for a different doctor.  In encountering standardized patients in our scenarios or in reflecting on patients seen in clinical settings, students acknowledged that these conversations were difficult, and they were able to self-assess their level of comfort with conversations.

This was well-summarized in one reflection: “It was remarkable to me how such a strong reaction from this patient’s mother elicited an equally strong reaction in me.”

[Year2_34]

 

At times students recognized a point where these difficult conversations could reach a dead end. One student stated, “No matter how hard I would try, nothing seemed to work.”

[Year2_03]

Especially in this context, students reflected ambivalence towards the patient’s decision. For example:

“I personally feel that providers allowing for healthy children on their patient panels to remain unvaccinated indirectly reinforces non-vaccination as being acceptable by the medical establishment. That said, I also see and appreciate that turning a child away from one’s practice because their parents refuse to vaccinate them not only does not solve the problem at hand, but it also leaves a child at a very critical developmental age with no health care at all until an alternative provider can be found. Ultimately, I found attempting to reconcile these seemingly incompatible sides of the issue of dealing with anti-vaccination quite confusing and uncomfortable.”

[Year2_86]

D. Insights for Providing Information and Developing a Plan with Hesitant Patients

A fourth theme centred on students’ insights regarding how to provide information appropriately to patients and how to create a plan with patients who were hesitant regarding the medical recommendations given to them. Medical students suggested a variety of ways to provide information to patients who were hesitant. They noted the importance of contributing relevant facts and evidence, stressing that such information and knowledge in general needed to be presented in an understandable manner.

As one student described, “Finding the appropriate words to use in such conversations with a patient is essential.”

[Year1_44]

Students often wrote that they needed to provide reputable information to inform the patient’s decision-making. Some suggested strategies for how to present information to patients, including the sharing of stories and the use of scary information to convey the level of seriousness of the medical recommendation and advice.

One student referenced storytelling in the literature, “…the use of storytelling, the same method used by the anti-vaccination movement, [can be] a way to counteract the barrage of misinformation regarding vaccines.”

[Year1_90]

Sharing these insights about how to present information, students also moved towards how to develop a plan with their patients with some deliberate suggestions. Some students felt they needed to be persistent in their recommendations for vaccines. Some students explained how intentional discussions on the risks and benefits of their recommendations can help in their negotiation about a care plan with their patients.

One student noted, “This draws along the line of patient autonomy, and as long as we are clear about the risks and benefits with the patient, then ultimately, it’s up to the patient to make the decision about which medications she will take.”

[Year1_52]

Submitted: 11 March 2022
Accepted: 28 June 2022
Published online: 4 April, TAPS 2023, 8(2), 14-35
https://doi.org/10.29060/TAPS.2023-8-2/OA2762

Sayaka Oikawa¹, Ruri Ashida² & Satoshi Takeda³

¹Center for Medical Education and Career Development, Fukushima Medical University, Fukushima, Japan; ²Center for International Education and Research, Tokyo Medical University, Tokyo, Japan; ³Department of Emergency Medicine, The Jikei University School of Medicine, Tokyo, Japan

Abstract

Introduction: There are various difficulties in treating foreign patients; however, the existing educational programs are still insufficient for addressing this issue. The purpose of this study is to investigate what difficulties are encountered in the treatment of foreigners in emergency departments, and to create scenarios for simulation-based education using real-life cases.

Methods: A cross-sectional anonymous survey to 457 emergency departments was conducted in 2018. Additionally, we conducted a survey of 46 foreign residents who had visited hospitals for treatment in Japan. The data was analysed quantitatively, and the narrative responses were thematically analysed.

Results: Of the 141 hospitals that responded (response rate: 30.9%), 136 (96.5%) answered that they had treated foreign patients. There were 51 and 66 cases with cultural and linguistic difficulties, respectively. In the qualitative analysis, different ideas/beliefs towards treatments or examinations (51.0%) and communication with non-English speaking patients (65.2%) were most common categories in the cases with cultural and linguistic difficulties, respectively. The survey of 46 foreign residents on the surprising aspects of Japanese healthcare showed, 14% mentioned difference in treatment plans between own country and Japan, 12% each mentioned a lack of explanation by medical staff, and a lack of privacy in the examination room. Based on the survey results, we created 2 scenarios of simulation.

Conclusions: Scenarios of simulation-based education using real-life cases may be effective materials for cultivating cultural awareness of medical staff.

Keywords:           Cultural Awareness, Cultural Humility, Emergency Department, Foreign Patients, Simulation-based Education

Based on the survey results, we decided the main topic of the scenarios based on the contents overlapped in multiple cases. “Gender restriction of doctors who treated patients” and “communication difficulty in languages other than Japanese or English” were the most frequent topics in cultural and linguistic difficulties respectively. Following the selection of topics, we synthesised the similar responses to create a scenario that could occur in any size of ED setting. We developed the settings including patient age, sex, language, and backgrounds, regarding that the patient characteristics can be demonstrated by simulated patients. As a result, we developed two scenarios: a scenario of abdominal pain in a Muslim female patient and a scenario of forearm fracture in a Chinese male patient (Appendices 5 and 6).  In the abdominal pain scenario, no female doctor was available, and a learner, a male doctor, had to examine and treat a simulated patient who refused to be seen by a male doctor. In the forearm fracture scenario, no interpreter was available, and a learner had to communicate with a simulated patient who spoke Chinese only. The learning objective for the learners was to communicate appropriately with patients with different cultural and linguistic backgrounds. Based on the results of the survey for foreign residents, we indicated the importance of listening to the patient’s concerns carefully as a teaching point. Also, we reflected the survey results of how each hospital handled the cases on the information for instructors and teaching points.

IV. DISCUSSION

At the time of writing this paper, 96.5% of the EDs had accepted foreign patients; and 82.3% had English-speaking staff. However, only 32.6% of the EDs had multilingual signs for patients, which is listed as actions to be taken in the manual for treating foreign patients (Japan Ministry of Health, Labour and Welfare, 2021).

In the present study, most of the EDs used translation tools when treating foreign patients. Various types of translation methods were found to be used in the EDs, the use of which is consistent with the manual for treating foreign patients (Japan Ministry of Health, Labour and Welfare, 2021). However, we found that the EDs still encountered a significant number of cases with linguistic difficulties. This suggests that even though the EDs own the translation tools, medical staff are not able to utilise them in communicating with foreign patients. According to our survey result, it was revealed that more than half of the cases with linguistic difficulties were of non-English speaking patients. To overcome the linguistic difficulties, medical staff need to be capable of using them enough to communicate with patients of various native languages. In addition to the use of translation tools, multilingual medical explanation/consent forms or signs in hospitals may be effectively used in the aim of communication with foreign patients.

Regarding culturally difficult cases, our survey showed the various issues caused by differences of religious background, lifestyles, and ideas and beliefs on treatment and testing between medical staff and patients. This result is consistent with the reports which elaborated difficulties in treating foreign patients in Japan (Tatsumi et al., 2016). Our study showed that different ideas/beliefs towards treatments or examinations was most common theme in the cases with cultural difficulties in EDs. Knowing beliefs of other culture is one of individual’s capabilities to manage effectively in culturally diverse settings (Ang et al., 2007), and a report on psychiatric hospitals showed that medical staff adapted to hospitalised foreign patients’ culture and religion as they built the relationships with the patients over a long period of time (Kobayashi et al., 2014). Whereas, it is difficult to build relationships with foreign patients in the acute ED setting. Thus, we realised that practical training of communication with foreign patients provide knowledge about their cultures and religions in limited time and is critically important for medical staff in EDs.

SBE is an effective educational format which makes learners’ unconscious incompetence to conscious incompetence (Morell et al., 2002), in other words, medical staff may be able to recognise their unconscious biases towards foreign patients by participating in SBE. As consistent with the previous survey by the MHLW (2021), the culturally difficult cases included complicated issues that require the cooperation of administrative staff and full-time English interpreters in the hospital. In the present study, we created the two scenarios targeting medical staff as learners based on the real-life cases with the many responses in the survey. However, we need to create more varieties of scenarios that can involve other professions than health care professionals. Furthermore, the acquisition and retention of learners’ skills in a single training session of SBE is limited (Legoux et al., 2021). SBE aimed at cultivating cultural awareness cannot be completed in a single session but in continuous sessions with multiple scenarios.

The results of our survey of foreign residents showed that they had been surprised at the differences in treatment plans between their country and Japan, a lack of explanation by medical staff, and a lack of privacy in the examination room. We found that it is important to investigate the opinions of those who receive medical care in a country different from their home because their perspectives allow us to recognise the things taken for granted among medical staff.  Medical staff’s unconscious biases about patients of different cultural backgrounds or national origins influence their decision-making (Tervalon & Murray-Garcia, 1998), and implicit bias can contribute to miscommunication (Bartlett et al., 2019). Therefore, listening to the concerns of foreign patients is important in order to avoid providing treatment based solely on medical staff’s biases. Furthermore, in creating scenarios, referring to the survey results of multiple stakeholders made the contents more multi-dimensional and relevant. This study was conducted in the contexts of EDs in Japan, however, scenarios created with perspectives of both medical staff and patients who have various cultural backgrounds may effectively address to the real-life problems triggered by unconscious biases, even in other contexts. 

In Emergency situations, we often focus on the patients’ cultural backgrounds, national origins, languages, and religious background in order to provide effective treatments. However, recognising our own bias is not achieved by only focusing on the patients’ culture. Self-reflection is necessary to recognise one’s own cultural biases. The process of self-reflection of our own culture is important for cultivating cultural awareness. Furthermore, the importance of cultural humility – discovering one’s own values toward other cultures through continuous self-reflection and becoming aware of one’s own relationship to the world – has been recently noted in medical education (Chang et al., 2012). As a further research, the development of scenarios that include the study guide which ensure the learners’ self-reflection is required for SBE in emergency settings.

There are several limitations in this study. The response rate of a survey for EDs was 30.9%, which is unable to deny sampling bias. We conducted a survey for EDs with a focus on English, however, it is necessary to conduct surveys on languages other than English. In addition, the survey was only for the EDs of training hospitals in the top 10 prefectures with the most foreign tourists. We may consider expanding the number of hospitals to collect more information about difficulties they encounter in treating foreign patients. For the sub study, the snowball sampling had a methodological limitation in calculating total number the survey sent. As a further research, impacts of SBE using these scenarios on the treatment of foreign patients is less clear. To assess whether foreign patients’ satisfaction of medical care will change, and whether unconscious bias towards foreign patients among medical staff will decrease by conducting these scenarios are necessary.

V. CONCLUSION

In the current study, we were able to clarify linguistic and cultural difficulties in treating foreign patients in the EDs. We developed the scenarios for SBE using the real-life difficult cases of foreign patients with linguistic or cultural differences in medical care in Japan. The simulation training using these scenarios may be useful for promoting cultural awareness of medical staff in EDs. In future, more varieties of scenarios of SBE need to be created and shared in order to treat foreign patients safely and adequately.

Notes on Contributors

SO contributed to the design of the study and conducted data collection and analysis. RA devised the project, the main conceptual ideas, and conducted data collection and analysis. ST contributed to the design of the study and the interpretation of the data.

Ethical Approval

This study was approved by the Institutional Review Board of The Jikei University School of Medicine Japan (Approval No. 28-211(8454), 28-276(8519)). An informed consent was obtained from all the participants responded to the survey.

Data Availability

The data that support the findings of this study are not openly available due to privacy. The materials are available from the corresponding author on reasonable request.

Acknowledgement

The authors would like to acknowledge the respondents at the EDs of training hospitals, the foreigners living in Japan, and the young clinicians at The Jikei University School of Medicine for their cooperation in the study. 

Funding

This work has been supported by JSPS KAKENHI, grant number 16K08883.

Declaration of Interest

The authors report no conflicts of interest. The authors alone are responsible for the content of the article.

References

Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. (2007). Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and Organization Review, 3(3), 335-371. https://doi.org/10.1111/j.1740-8784.2007.00082.x

Ashida, R., & Otaki, J. (2022). Survey of Japanese medical schools on involvement of English-speaking simulated patients to improve students’ patient communication skills. Teaching and Learning in Medicine, 34(1), 13-20. https://doi.org/10.1080/10401334.2021.1915789

Bartlett, K., Strelitz, P., Hawley, J., Sloane, R., & Staples, B. (2019). Explicitly addressing implicit bias in a cultural competence curriculum for pediatric trainees. MedEdPublish, 8. https://doi.org/10.15694/mep.2019.000102.1

Chang, E. S., Simon, M., & Dong, X. (2012). Integrating cultural humility into health care professional education and training. Advances in Health Sciences Education, 17(2), 269–278. https://doi.org/10.1007/s10459-010-9264-1

Hobgood, C., Sawning, S., Bowen, J., & Savage, K. (2006). Teaching culturally appropriate care: a review of educational models and methods. Academic Emergency Medicine, 13(12), 1288-1295. https://doi.org/10.1197/j.aem.2006.07.031

Japan Ministry of Economy, Trade and Industry. (2019, January). Kokunai iryokikan ni okeru gaikokujin kanja no ukeire jittai chosa [Survey on the actual conditions of foreign patients accepted at domestic medical institutions in Japan]. https://www.meti.go.jp/policy/mono_info_service/healthcare/iryou/inbound/activity/survey_report.html

Japan Ministry of Health, Labour and Welfare. (2021, March). Gaikokujin kanja no ukeire no tameno iryokikan muke manyuaru [A manual for medical institutions to accept foreign patients]. https://www.mhlw.go.jp/content/10800000/000795505.pdf

Japan Tourism Agency. (2018, February). Shukuhakuryoko tokeichosa hokokusho [Report on the survey of accommodations and travel statistics]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/common/001220398.pdf

Japan Tourism Agency. (2019, March). Honichi gaikokujin ryokosha no iryo ni kansuru jittaichosa ukeire kankyo no seibikyoka wo okonaimashita [Conducted a survey on the actual conditions of medical care for foreign visitors to Japan and strengthened the development of the receiving environment]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/kankocho/news08_000272.html

Japan Tourism Agency. (2021, June). Shukuhakuryoko tokeichosa [Survey of accommodations and travel statistics]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/kankocho/siryou/toukei/content/001413644.pdf

Kelly, M. A., Balakrishnan, A., & Naren, K. (2018). Cultural considerations in simulation-based education. The Asia Pacific Scholar, 3(3), 1-4. https://doi.org/10.29060/TAPS.2018-3-3/GP10 70

Kobayashi, Y., Yoshimitsu, Y., & Kato, S. (2014). Super kyukyu ni okeru kangoshi no gaikokujinkanja nitaishite ninshiki suru mondai to taio no jissai [Nurses’ perceptions of and responses to foreign patients in a super emergency hospitals]. Nihon Seishinka Kango Gakujutsu Shukaishi [The Japanese Psychiatric Nursing Society], 57(3), 379 383.

Kubo, Y., Takaki, S., Nomoto, Y., Maeno, Y., & Kawaguchi, Y. (2014). Nihon no byoin ni okeru kyukyugairai deno gaikokujinkanja heno kango no genjo ni kansuru chosa. [A survey on the current status of nursing care for foreign patients in emergency departments in Japanese jospitals]. Kosei no shihyo [Journal of Health and Welfare Statistics], 61(1), 17-25.

Leake, R., Holt, K., Potter, C., & Ortega, D. M. (2010). Using simulation training to improve culturally responsive child welfare practice. Journal of Public Child Welfare, 4(3), 325-346. https://doi.org/10.1080/15548732.2010.496080

Legoux, C., Gerein, R., Boutis, K., Barrowman, N., & Plint, A. (2021). Retention of critical procedural skills after simulation training: a systematic review. AEM Education and Training, 5(3), e10536. https://doi.org/10.1002/aet2.10536

Mechanic, O. J., Dubosh, N. M., Rosen, C. L., & Landry, A. M. (2017). Cultural competency training in emergency medicine. The Journal of Emergency Medicine, 53(3), 391-396. https://doi.org/10.1016/j.jemermed.2017.04.019

Morell, V. W., Sharp, P. C., & Crandall, S. J. (2002). Creating student awareness to improve cultural competence: creating the critical incident. Medical Teacher, 24(5), 532-534. https://doi.org/10.1080/0142159021000012577

Motola, I., Devine, L. A., Chung, H. S., Sullivan, J. E., & Issenberg, S. B. (2013). Simulation in healthcare education: a best evidence practical guide. AMEE Guide No. 82. Medical Teacher, 35(10), e1511-e1530. https://doi.org/10.3109/0142159X.2013.818632

NHS England. (2016). NHS England response to the specific duties of the Equality Act. Equality information relating to public facing functions. https://www.england.nhs.uk/wp-content/uploads/2016/02/nhse-specific-duties-equality-act.pdf

Office of Disease Prevention and Health Promotion. (2021, August). Disparities. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. https://www.healthypeople.gov/2020/about/foundation-health-measures/Disparities

Osegawa, M., Morio, H., Nomoto, K., Nishizawa, M., & Sadahiro, T. (2002). Present medical practice and problems in emergency disease in foreign travelers requiring hospital admission. Nihon Kyukyu Igakukai Zasshi [Journal of Japanese Association for Acute Medicine], 13(11), 703-710. https://doi.org/10.3893/jjaam.13.703

Paroz, S., Daele, A., Viret, F., Vadot, S., Bonvin, R., & Bodenmann, P. (2016). Cultural competence and simulated patients. The Clinical Teacher, 13(5), 369-373. https://doi.org/10.1111/tct.12466

Serizawa, A. (2007). Developing a culturally competent health care workforce in Japan: implications for education. Nursing education perspectives, 28(3), 140-144.

Seropian, M. A. (2003). General concepts in full scale simulation: getting started. Anesthesia & Analgesia, 97(6), 1695-1705. https://doi.org/10.1213/01.ane.0000090152.91261.d9

Tatsumi, Y., Sasaki-Otomaru, A., & Kanoya, Y. (2016). The actual situation and issues of emergency medical services for foreigners staying in Japan extracted by systematic review. Nihon Kenko Igakukai Zasshi [Journal of Japan Health Medicine Association], 25(2), 91-97.

Tervalon, M., & Murray-Garcia, J. (1998). Cultural humility versus cultural competence: A critical distinction in defining physician training outcomes in multicultural education. Journal of Health Care for the Poor and Underserved, 9(2), 117-125. https://doi.org/10.1353/hpu.2010.0233

*Sayaka Oikawa
Center for Medical Education and Career Development,
Fukushima Medical University,
1 Hikarigaoka, Fukushima, 960-1295, Japan
Email: sayaka9@fmu.ac.jp

Submitted: 11 February 2022
Accepted: 21 July 2022
Published online: 4 April, TAPS 2023, 8(2), 4-13
https://doi.org/10.29060/TAPS.2023-8-2/OA2755

Tri Nur Kristina¹, Fatikhu Yatuni Asmara², Sudaryanto Sudaryanto¹, Nuryanto Nuryanto³ & Saekhol Bakri¹

¹Department of Medicine, Faculty of Medicine, Universitas Diponegoro, Indonesia; ²Department of Nursing, Faculty of Medicine, Universitas Diponegoro, Indonesia; ³Department of Nutrition, Faculty of Medicine, Universitas Diponegoro, Indonesia

Abstract

Introduction: This study aimed to examine the usefulness of Community Based-Education (CBE) and Interprofessional Education (IPE) to community health outcomes.

Methods: The design was a mixed-method study. Each small group worked together to identify family health problems, implement interventions, and evaluate the results. The Readiness for Interprofessional Learning Scale (RIPLS) questionnaire was applied to compare students’ perceptions before and after the implementation. In addition, qualitative data were acquired from students’ comments on the questionnaire, interviews with community representatives, and FGDs with instructors at the end of the program.

Results: Three hundred and sixty-seven out of 465 students returned the completed paired questionnaire (78.9 % response rate). Paired t-test showed that student perception of responsibility slightly increased, whereas teamwork and collaboration, negative and positive professional identity decreased somewhat. However, most pre-post students’ responses already trended to the positive side (scales 4 and 5). Moreover, the Chi-square test showed that pre-post students’ confidence levels significantly increased. Most small groups of students successfully empowered the community to solve health problems. Students, instructors, and representatives of community members appreciated the program. However, several students felt their instructors were not motivated to mentor their tasks, and sometimes they had difficulty conducting home visits together. 

Conclusion: This study showed that the combination of CBE-IPE contributes to more favourable community health outcomes. However, it was challenging in several aspects of preparation, including highly motivated instructors. Nevertheless, pre and post-implementation students’ attitudes are still positive.

Keywords:           Interprofessional Education (IPE), Community Based Education (CBE), Health Profession Students, Readiness

Published online: 4 April, TAPS 2023, 8(2), 1-3
https://doi.org/10.29060/TAPS.2023-8-2/EV8N2

Shuh Shing Lee¹ & John Norcini²

¹Centre for Medical Education, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; ²Foundation for Advancement of International Medical Education and Research, United States of America

It has been almost three decades since Boyer (1990) introduced the concept of the Scholarship of Teaching and Learning (SoTL). In their own disciplines, faculty members are required to stay abreast of emerging knowledge and to contribute to the literature so that they advance their field through well-informed inquiry and disseminated work. Although they also have educational responsibilities, faculty are neither similarly motivated nor are they incentivised to participate in educational scholarship. Consequently, their efforts in this regard are often based on personal belief and opinion rather evidence and scientific inquiry. This problem persists despite a growing body of evidence that adopting sound instructional practices and pursuing scholarly work related to teaching, will increase the quality of the institution’s educational processes. In turn, this will enhance student learning and ultimately lead to better patient care. To achieve this end, teaching and learning must be scrutinised in terms of theory, methods, evidence, and outcomes. And faculty members who engage in teaching need to be rewarded for their participation in educational scholarship just as they are for efforts in their own disciplines.

In supporting educators’ SoTL journey and enhancing the quality of their teaching, this special issue “Celebrating Excellence in Scholarship of Teaching and Learning” aims to demonstrate how educators adopt a scholarly approach and how they collect and present rigorous evidence of their effectiveness. It encompasses much of current health professions education, touching on topics such as interprofessional education, the globalisation of healthcare, the impact of COVID-19, vaccine hesitancy, and digital badges.

Educators from Indonesia shared their strategy for enhancing interprofessional education through community-based education (Kristina et al., 2023). Teams of students developed solutions to family health issues together. The authors found implementation challenges when applying this model, especially in terms of scheduling home visits. However, through this experience the students learned the value of teamwork and the roles of each of the representatives.

As a result of globalisation, there is a significant increase in the number of patients being admitted to hospitals outside of their home countries. The Emergency Department is often the first point of contact for these foreign patients and cultural differences naturally pose challenges. To address this issue and to help patients with different backgrounds obtain high quality care, some hospitals in Japan have initiated cultural awareness training for their doctors. While this is a positive step, doctors in the Emergency Department in Japan still face difficulties in this area. To address these challenges going forward, educators from Japan would like to identify the difficulties still encountered and eventually design scenarios, based on real life cases, for use in simulations (Oikawa et al., 2023).

COVID-19 has changed the way teaching has occurred and it has accelerated the use of technology in all phases of education. This special edition contains two Case Studies related to this issue. The report by Kushare et al. (2023) takes on the use of blended learning that occurred synchronously at different campuses in Malaysia. The report by Lim et al. (2023) focuses on student perspectives on the prohibition of direct patient contact during pandemic. It will be important to follow future developments in these areas as restrictions are lifted.

COVID-19 has not only affected teaching, but it has also had a profound influence on the practice of medicine. Vaccine hesitancy among patients is a growing phenomenon for which not all health care providers are prepared. Physicians may have misconceptions about what drives patient behaviour leading to the less effective provision of information and counselling. To better understand this issue and design a relevant curriculum to create awareness, Jenkins et al. (2023) explored medical students’ reactions to vaccine hesitancy and their reflections on their own biases in patient interactions. The qualitative analysis of students’ reflections offered by the authors is a useful basis for working with students around this issue. 

In recent years, digital badges have increasingly become a part of the educational landscape. They constitute an innovative instructional strategy combing the teaching and credentialing of competencies to provide evidence for achievement. However, research in this area is scare. Truskowska et al. (2023) introduced a pilot project regarding the use of digital badges in a Psychiatry module offered as part of a continuous assessment programme. They evaluated the effectiveness of the digital badges based on students’ perspectives of their utility, their level of engagement with the module, and their motivation to study. Students found the badges rewarding but noted that their value was unclear which would eventually lead to a loss of motivation.

Assessment has been a main topic of discussion in SoTL because it shapes how student learn and informs teachers about the effectiveness of their own work. Dayanidhi et al. (2023) present information about a radical curriculum and assessment reform that has been taken place in India. Forensic Medicine and Toxicology, a major competence, is often underrepresented in assessment. The authors established this through an analysis and comparison of the distribution of content tested, domain of learning and construct of the questions derived from undergraduate summative examination question papers on the topic from six universities across India. Also focused on assessment, Lim and Lim (2023) share an innovative assessment method – oral interactive assessment– which they have implemented among the occupational therapy students. Instead of multiple-choice questions or short written answers, each student was assessed with a standardised actor who simulate concerned parents, asking questions about their children’s development. While students are more anxious with this format, an interactive oral assessment has real world relevance.

There are several articles discussing initiatives that were conducted for faculty members in this special issue. For example, Lim et al. (2023) described a coaching programme aimed at providing educators a framework that helps students make discoveries and work towards their goals and training them how to question students. Field et al. (2023) offered a study in training their faculty members to teach and assess students’ clinical thinking skills using a model. Goh and Schlegal (2023) examined the journey of scholarship in health professions education and suggested tangible small steps to start, sustain, and succeed along the SoTL journey.

Felten (2013) in his paper “Principles of Good Practice in SoTL” mentioned that good scholarship should be grounded in context because it takes place in a particular classroom, institution, organisation, and education system where the culture is bounded. Tan et al. (2023) elaborated this aspect in his article using Bronfenbrenner’s Ecological Systems theory (EST). Grant (2023), similarly, highlighted the notion that the practice of teaching is socially bound and highly dependent on the culture, content and context. She further described the relationship between medical educationalists and teachers in the entire SoTL journey.

Good teaching is multidimensional, challenging, and contextual as demonstrated by all the authors in this special issue. However, this is an excellent place to start and it encourages all of us to apply the same thoughts processes to our teaching as we do in our discipline-specific research. Teaching is a process of reflection on our practice and if we follow this dictum, more scholarly teaching will result in higher quality in learning among our students. 

 

Shuh Shing Lee & John Norcini
Guest Editors 
The Asia Pacific Scholar (TAPS) 

 

Boyer, E. L. (1990). Scholarship revisited: Priorities of the professionals. Carnegie Foundation for the Advancement of Teaching.

Dayanidhi, V. K., Datta, A., Hegde, S. P., & Tiwari, P. (2023). Evaluating the content validity of the undergraduate summative exam question papers of Forensic Medicine & Toxicology from 6 medical universities in India. The Asia Pacific Scholar, 8(2), 57-65. https://doi.org/10.29060/TAPS.2023-8-2/OA2778

Felten, P. (2013). Principles of Good Practice in SoTL. Teaching & Learning Inquiry: The ISSOTL Journal, 1(1), 121-125. https://doi.org/10.2979/teachlearninqu.1.1.121

Field, S., Croskerry, P., Love, S., & Alexiadis Brown, P. (2023). An online programme in teaching and assessing critical thinking for medical faculty. The Asia Pacific Scholar, 8(2), 66-69. https://doi.org/10.29060/TAPS.2023-8-2/SC2894

Goh, P. S., & Schlegal, E. F. M. (2023). Small, sustainable, steps to success as a scholar in Health Professions Education – Micro (macro and meta) matters. The Asia Pacific Scholar, 8(2), 76-79. https://doi.org/10.29060/TAPS.2023-8-2/SC2861

Grant, J. (2023). The Scholarship of teaching: Who is the truth teller? The Asia Pacific Scholar, 8(2), 83-85. https://doi.org/10.29060/TAPS.2023-8-2/PV2874

Jenkins, M. C., Paul, C. R., Chheda, S., & Hanson, J. L. (2023). Qualitative analysis of reflective writing examines medical student learning about vaccine hesitancy. The Asia Pacific Scholar, 8(2), 36-46. https://doi.org/10.29060/TAPS.2023-8-2/OA2855

Kristina, T. N., Asmara, F. Y., Sudaryanto, S., Nuryanto, N., & Bakri, S. (2023). Increasing the value of Community-Based Education through Interprofessional Education. The Asia Pacific Scholar, 8(2), 4-13. https://doi.org/10.29060/TAPS.2023-8-2/OA2755

Kushare, V., MK., B., Pamidi, N., Selvaratnam, L., Sen, A., & Dominic, N. A. (2023).  Vertical integration of anatomy and women’s health: Cross campus blended learning. The Asia Pacific Scholar, 8(2), 89-92. https://doi.org/10.29060/TAPS.2023-8-2/CS2806

Lim, M. J., Wee, J. C. P., Han, D. X. T., & Wong, E. (2023). Perspectives of medical students towards the prohibition of direct patient contact during a pandemic. The Asia Pacific Scholar, 8(2), 93-96. https://doi.org/10.29060/TAPS.2023-8-2/CS2849

Lim, S. M., & Lim, C. Y. (2023). Use of interactive oral assessment to increase workplace readiness of occupational therapy students. The Asia Pacific Scholar, 8(2), 86-88. https://doi.org/10.29060/TAPS.2023-8-2/SC2804

Lim, S. M., Shahdadpuri, R., & Pua, C. Y. (2023). Coaching as an educator: Critical elements in a faculty development program. The Asia Pacific Scholar, 8(2), 70-75. https://doi.org/10.29060/TAPS.2023-8-2/SC2802

Oikawa, S., Ashida, R., & Takeda, S. (2023). Increasing cultural awareness in emergency departments with simulation scenarios created through a survey. The Asia Pacific Scholar, 8(2), 14-35. https://doi.org/10.29060/TAPS.2023-8-2/OA2762

Tan, K., Foo, Y. Y., & Tan, N. C. K. (2023). Refocusing SoTL – Myopia, context lenses and ecological systems theory. The Asia Pacific Scholar, 8(2), 80-82. https://doi.org/10.29060/TAPS.2023-8-2/PV2842

Truskowska, E., Emmett, Y., & Guerandel, A. (2023). Digital badges: An evaluation of their use in a Psychiatry module. The Asia Pacific Scholar, 8(2), 47-56. https://doi.org/10.29060/TAPS.2023-8-2/OA2869

Published online: 3 January, TAPS 2023, 8(1), 1-2
https://doi.org/10.29060/TAPS.2023-8-1/EV8N1

COVID pandemic created worldwide disruptions to all services and had profound impact on training of health professionals, posing serious challenges to maintaining essential healthcare services. During the height of the pandemic, most of the undergraduate learners were prevented from clinical training sites, restricted intra, inter-institutional and overseas learning opportunities and in many institutions, there were termination of onsite learner-educator engagements (Ng et al., 2021; Renaud et al., 2021; Samarasekera et al., 2020). Less face to face, peer and faculty interactions and restricted mobility of learners led to some of them facing poor mental wellbeing and health issues.  The learning activities were mostly restricted to online platforms during the pandemic for students following health professional programs. During the latter part of the pandemic, however, there were changes when better preventive measures and immunisation were developed. The students were also allowed to provide limited care services to assist the practitioners who were providing critical services (Lau et al., 2021).

The silver lining, however, was that several new curricular designs, teaching-learning and assessment modalities were developed due to the sheer necessity. The faculty members and students were forced to adapt and adopt these new measures, mostly online systems and processes, to continue the training and provide that much needed support to the healthcare services (Shorey et al., 2022). This became critical when it was apparent that the pandemic would continue for several years. There are some such innovations in teaching-learning highlighting not only the innovation and their impact but also the challenges faced by students and faculty members. Most of these changes to student learning environment were done hurriedly and, unfortunately, without the proper grounding in best evidence practices or taking a systematic approach to incorporate changes to a curriculum. Another reason was the lack of knowledge and support of educators to develop impactful curricula and learning environments leveraging on technology (Popa, 2022).

We are now emerging from the pandemic and many lessons have been learnt from this experience. We now have an opportunity to leapfrog from these experiences. The key to creating an impactful and sustainable post-pandemic learning environment lies with the faculty members. There are several important areas we need to focus on if we want to sustain and further improve the education based on our past experience.

As part of faculty development, it is necessary to engage our faculty members to share best practices and assist them to co-create with their learners teaching-learning activities. For faculty leadership, it is critical to create that safe practice environment for all stakeholders to reflect on and improve what they have developed. Through these collaborative activities, not only the faculty members learn about what works and what to avoid, but also build trust with other stakeholders including the students. Furthermore, it supports them to critically analyse the learning and assessment activities with regard to their relevance in one’s context. Providing a structured and timely faculty support with the necessary resources will augment the building of trust (Connolly et al., 2022).

Another important area we learnt especially during the pandemic and as we currently emerge from the pandemic is the necessity to modify the existing policies and guidelines. These should support systematic and rapid development of learning environments. What worked in the past may not be appropriate now, and even hinder the development of innovative strategies. We need to relook at how we evaluate an educator’s performance and the learning impact from traditional matrixes in place at present in health professional training institutions. Aligned to the performance evaluations, there needs to be supportive schemes to incentivise and reward faculty members who contributed to enhance the learning environment for students and residents.

Medical education is very much context-based and situation-focused. What worked in one setting may not be appropriate in another learning context. The leadership, planners, and educators must be aware of this and carefully design and incorporate innovations and new approaches to learning that have worked in another setting to one’s own. This is especially true when one is incorporating technology-enhanced learning activities such as simulation based or remote distance online learning formats. Finally, the quality improvement and quality assurance processes in health professions education must be aligned to the local context needs. These standards, however, should be benchmarked to internationally accepted best practices, but situated very much on the local needs and promoting impactful changes to student learning environments (Samarasekera & Gwee, 2021).

A quick literature search at present will demonstrate large number of innovations and changes that were incorporated to medical and health professional training curricula over the pandemic period (Ng et al., 2021). It is an opportune time now to focus on developing these changes, based on best evidence practices., The impact of these changes need to be subsequently evaluated to further enhance student learning. At the end of it all, what is most vital is to provide quality care to our patients by competent, caring, and empathetic health professionals.

 

Dujeepa D. Samarasekera 
Centre for Medical Education (CenMED), NUS Yong Loo Lin School of Medicine,
National University Health System, Singapore

 

 

 

Connolly, K. K., Olson, H. L., & Buenconsejo-Lum, L. E. (2022). Medical school faculty development post-pandemic – Opportunities in the digital shift. Hawai’I Journal of Health & Social Welfare, 81(11), 316-318.

Lau, T. C., Chong, Y. S., Loo, B. K. G., Ganapathy, S., Ho, J. M. D., Lee, S. S., Yeo, J., Samarasekera, D. D., & Goh, D. L. M. (2021). Adapting undergraduate paediatric medical education to the challenges of COVID-19 pandemic: Perspective of NUS medicine. Singapore Medical Journal, 62(1 Supp), S39-S42. https://doi.org/10.11622/smedj.2021075

Ng, N. B. H., Chiong, T., Lau, P. Y. W., & Aw, M. A. (2021). Delivering medical education amidst COVID-19: Responding to change during a time of crisis. The Asia Pacific Scholar, 6(3), 111-113. https://doi.org/10.29060/TAPS.2021-6-3/PV2375

Popa, S. (2022). Taking stock: Impacts of the Covid-19 pandemic on curriculum, education, and learning. PROSPECTS, 51, 541-546. https://doi.org/10.1007/s11125-022-09616-7

Renaud, C. J., Chen, Z. X., Yuen, H.-W., Tan, L. L., Pan, T. L. T., & Samarasekera, D. D. (2021). Impact of COVID-19 on health profession education in Singapore: Adoption of innovative strategies and contingencies across the educational continuum. The Asia Pacific Scholar, 6(3), 14-23. https://doi.org/10.29060/TAPS.2021-6-3/RA2346

Samarasekera, D. D., Goh, D. L. M., & Lau, T. C. (2020). Medical school approach to manage the current COVID-19 crisis. Academic Medicine, 95(8), 1126-1127. https://doi.org/10.1097/ACM.0000000000003425

Samarasekera, D. D., & Gwee, M. C. E. (Eds.). (2021). Educate, train and transform: Toolkit on medical and health professions education. World Scientific.

Shorey, S., Pereira, T. L.-B., Teo, W. Z., Ang, E., Lau, T. C., & Samarasekera, D. D. (2022). Navigating nursing curriculum change during COVID-19 pandemic: A systematic review and meta-synthesis. Nurse Education in Practice. 65, Article 103483. https://doi.org/10.1016/j.nepr.2022.103483