Increasing cultural awareness in emergency departments with simulation scenarios created through a survey
Submitted: 11 March 2022
Accepted: 28 June 2022
Published online: 4 April, TAPS 2023, 8(2), 14-35
https://doi.org/10.29060/TAPS.2023-8-2/OA2762
Sayaka Oikawa1, Ruri Ashida2 & Satoshi Takeda3
1Center for Medical Education and Career Development, Fukushima Medical University, Fukushima, Japan; 2Center for International Education and Research, Tokyo Medical University, Tokyo, Japan; 3Department of Emergency Medicine, The Jikei University School of Medicine, Tokyo, Japan
Abstract
Introduction: There are various difficulties in treating foreign patients; however, the existing educational programs are still insufficient for addressing this issue. The purpose of this study is to investigate what difficulties are encountered in the treatment of foreigners in emergency departments, and to create scenarios for simulation-based education using real-life cases.
Methods: A cross-sectional anonymous survey to 457 emergency departments was conducted in 2018. Additionally, we conducted a survey of 46 foreign residents who had visited hospitals for treatment in Japan. The data was analysed quantitatively, and the narrative responses were thematically analysed.
Results: Of the 141 hospitals that responded (response rate: 30.9%), 136 (96.5%) answered that they had treated foreign patients. There were 51 and 66 cases with cultural and linguistic difficulties, respectively. In the qualitative analysis, different ideas/beliefs towards treatments or examinations (51.0%) and communication with non-English speaking patients (65.2%) were most common categories in the cases with cultural and linguistic difficulties, respectively. The survey of 46 foreign residents on the surprising aspects of Japanese healthcare showed, 14% mentioned difference in treatment plans between own country and Japan, 12% each mentioned a lack of explanation by medical staff, and a lack of privacy in the examination room. Based on the survey results, we created 2 scenarios of simulation.
Conclusions: Scenarios of simulation-based education using real-life cases may be effective materials for cultivating cultural awareness of medical staff.
Keywords: Cultural Awareness, Cultural Humility, Emergency Department, Foreign Patients, Simulation-based Education
I. INTRODUCTION
According to the Japan Tourism Agency (JTA), the number of foreign visitors to Japan was increasing every year in the midst of the recent rapid globalisation (Japan Tourism Agency, 2021). Although it is currently on the decline due to COVID-19 infection, a survey of foreign visitors to Japan conducted by the JTA in 2018 revealed that 5% of 3,000 visitors had suffered injuries or illnesses while visiting Japan (Japan Tourism Agency, 2019). When visiting a medical institution in an unfamiliar country, patients have anxiety due to language and cultural differences. Various measures are being taken around the world to prevent patients with different cultural backgrounds from being disadvantaged in medical care (NHS England, 2016; Office of Disease Prevention and Health Promotion, 2021), such as training medical staff to recognise factors impeding cultural awareness (Hobgood et al., 2006).
Due to its nature, prompt treatment is required in emergency departments (EDs). Previous reports showed that among 97 EDs in Japan, 84 had some difficulties in treating foreign patients (Kubo et al., 2014), and medical staff faced complex cultural and social problems with foreign patients (Osegawa et al., 2002). According to the reports of Japanese government, health care institutions in Japan organise English conversation training or lectures on cultural differences by foreign lecturers for medical staff to improve treatment of foreign patients (Japan Ministry of Economy, Trade and Industry, 2019; Japan Ministry of Health, Labour and Welfare, 2021). However, a training for cultivating cultural awareness among medical staff who take care of foreign patients is still insufficient (Osegawa et al., 2002; Serizawa, 2007).
Simulation-based education (SBE) is a practical learning method which enables mastery learning (Kelly et al., 2018; Motola et al., 2013), and in Japan, English-speaking simulated patients are increasingly introduced in medical education (Ashida & Otaki, 2022). Simulated patients enhance reflective learning which improves cultural awareness of learners (Leake et al., 2010; Paroz et al., 2016). However, according to a survey of emergency training programs, less than 10% of the programs used SBE as a training method for cultivating cultural awareness (Mechanic et al., 2017).
The purposes of this study were to investigate what difficulties are encountered in the treatment of foreigners in EDs, and to create scenarios of SBE using real-life cases.
II. METHODS
In January 2018, we sent a questionnaire to 457 EDs of residency training hospitals in the top 10 prefectures with the highest number of foreign visitors, Hokkaido, Chiba, Tokyo, Kanagawa, Shizuoka, Aichi, Kyoto, Osaka, Fukuoka, and Okinawa (Japan Tourism Agency, 2016), by postal mail. In an anonymous survey, we asked about the hospital readiness for treating foreign patients and about difficult cases of foreign patients with linguistic or cultural differences in medical care (Appendix 1). The questions about readiness on treating foreign patients were analysed by simple percentages, and descriptive statistics were used for the questions about number of patients visiting ED per day. The narrative responses were collated and thematic analysis was performed. First, two authors created codes, generated several categories based on the codes, and sorted each case into categories independently as an investigator triangulation. Following that, we merged categories that were similar and revised categories that were different in interpretation through discussion. We repeated the member checking until we built our consensus, and the final categorisation was confirmed by all authors. The number of cases in each category was also calculated.
As a sub study, we also conducted a survey of 46 foreigners who were residing in Japan and had visited the hospital for treatment in Japan (hereafter foreign residents) to find patients’ perspectives on medical care in Japan (Appendix 2). The questionnaire was initially sent to those who were recruited by the authors via email using Google form from January to May in 2018, and data were collected by snowball sampling. The data were analysed by simple percentages, and for narrative responses, we created codes and sorted the responses into categories. The number of responses in each category was also calculated. Both questionnaires stated that the participants’ responses would be considered as their consent to the study, and the answers would be used anonymously for educational research.
Following the survey analysis, we selected cases suitable for scenario creation from an educational perspective with focus on the following points: 1) cases which were noted by multiple facilities, 2) difficulties that can be demonstrated by simulated patients; and 3) cases which had teaching points for multiple professions. The scenarios were composed following the Scenario Folder Sections by Seropian (2003) and included case description, manual for simulated patients, and teaching guide for the instructors. The scenarios were reviewed by an experienced medical English communication teacher from a linguistic and cultural standpoint, and by 2 experienced emergency medicine physicians from a medical standpoint. All 3 experts co-reviewed the final scenarios.
III. RESULTS
A. Survey of the EDs
1) Characteristics of the responding EDs: We received responses to the questionnaire from 141 EDs (response rate: 30.9%). Of these, 136 (96.5%) answered that they had accepted foreign patients, 116 (82.3%) had English-speaking staff, and 76 (53.9%) used translation tools or manuals. On the other hand, only 13 (9.2%) answered that they had a full-time English interpreter, and 27 (19.1%) had a website in English. The median number of overall outpatients visiting the ED per day was 30 (1–135), and the median number of foreign patients visiting the ED per day was 0.5 (0–8.3) (Table 1). As for translation method, a variety of methods were used. Of the 76 EDs, 36 (47.4%) answered that they used translation applications on tablet/PC or smartphone (Appendix 3).
|
Total Responded Hospitals |
141 |
|
|
|
|
Readiness on treating foreign patients |
n |
( % ) |
||
|
Have accepted foreign patients |
136 |
( |
96.5 |
) |
|
Have an English-speaking staff |
116 |
( |
82.3 |
) |
|
Use translation tools or manuals |
76 |
( |
53.9 |
) |
|
Have English medical history forms |
52 |
( |
36.9 |
) |
|
Have English medical certificates |
50 |
( |
35.5 |
) |
|
Have English signs for patients |
46 |
( |
32.6 |
) |
|
Have English medical explanation / consent forms |
27 |
( |
19.1 |
) |
|
Have a hospital website in English |
27 |
( |
19.1 |
) |
|
Have a full-time English interpreter |
13 |
( |
9.2 |
) |
|
No. of patients visiting emergency department per day |
Median |
|
Range |
|
|
Total |
30 |
( |
1-135 |
) |
|
Foreign patients |
0.5 |
( |
0-8.3 |
) |
Table 1: Characteristics of the responding hospitals.
2) Cases with cultural / linguistic difficulties: Cultural difficulties were encountered in 51 cases, and linguistic difficulties were encountered in 66 cases. In the thematic analysis, the cultural difficulties were classified into 4 categories: different ideas/beliefs towards treatments or examinations, medical fees, patients’ lifestyle, and others. The linguistic difficulties were classified into 4 categories: communication with non-English-speaking patients, communication with English-speaking patients, communication with interpreters or using translation tools, and others. Different ideas/beliefs towards treatments or examinations (51.0%), and communication with non-English-speaking patients (65.2%) were the most common, respectively. Case examples in each category and how the hospital handled to the cases are shown in Table 2.
|
Cases with cultural difficulties (51 cases) |
|||
|
Categories |
n (%) |
Examples and ways they were handled |
|
|
1 |
Different ideas/beliefs towards treatments or examinations |
26 (51.0) |
The patient’s husband requested that only female medical staff be allowed to examine the patient. -Initially, the doctor in charge was a male, but he was switched to a female doctor. |
|
2 |
Medical fees |
10 (19.6) |
The patient’s credit card was over its limit and he/she could not pay for the hospitalisation. -They asked the embassy of his/her country to handle the international money transfer.
|
|
3
|
Patients’ lifestyle
|
7 (13.7)
|
The patient complained about the predominantly rice-based diet during his/her hospitalisation. -They changed his/her diet to the bread-based one during the hospitalisation. |
|
4 |
Others |
8 (15.7) |
The patient had a low threshold for pain and was very assertive about the pain. -They confirmed that the complaint was due to pain and prescribed adequate painkillers.
|
|
Cases with linguistic difficulties (66 cases) |
|||
|
Categories |
n (%) |
Examples and ways they were handled |
|
|
1 |
Communication with non-English-speaking patients |
43 (65.2) |
The medical staff could not communicate with the patient in either English or Japanese. -They used a translation tool to communicate. |
|
2 |
Communication with English-speaking patients |
10 (15.2) |
The medical staff could understand ordinary conversation, but it was difficult for them to explain medical terms in English. -The English-speaking staff helped them. |
|
3 |
Communication with interpreters or translation tools |
9 (13.6) |
The patient brought in an interpreter, but it was unclear if the interpreter was able to understand the details. -They asked an interpreter to support. |
|
4 |
Others |
4 (6.1) |
The patient asked to provide a medical certificate in his/her native language. -They could not provide a medical certificate in the patient’s native language, so we provided one in English. |
Table 2: Categories of cultural and linguistic difficulties, their examples and ways handled
B. A Survey of the Foreign Residents
As regards the questionnaire sent to the foreign residents, we received 46 responses. Of those, 11 (23.9%) had lived in Japan for more than 30 years. In the multiple-answer questions regarding the reasons for visiting the hospital, 11 (8.2%) answered acute illness treated in the ED (The demographic data of foreigners responded to the survey is shown in Appendix 4). In terms of interpretation in the hospital, 10 (21.7%) answered that they have had some means of interpretation. For the question “What aspects of your medical care in Japan were most surprising or different from those in your country?”, of a total of 50 responses with multiple answers, 7 (14%) answered “difference in treatment plans between own country and Japan ” while 6 respondents (12%) each answered “a lack of explanation by medical staff” and “a lack of privacy in the examination room” (Table 3).
|
Questions about the medical care/staff |
Answer |
No. (%) in total respondents |
|||||
|
Q1 |
Did you have any means of interpretation in the hospital? |
Yes |
10 (21.7) |
||||
|
No |
36 (78.3) |
||||||
|
Q2 |
Could you tell the doctor/nurse about your concerns in history taking? |
Yes |
27 (58.7) |
||||
|
Somewhat |
18 (39.1) |
||||||
|
No |
1 (2.2) |
||||||
|
|
|||||||
|
Q3 |
Did you feel the doctor/nurse really cared for your ideas and culture during the history taking? |
Yes |
23 (50.0) |
||||
|
Somewhat |
17 (37.0) |
||||||
|
No |
6 (13.0) |
||||||
|
Q4 |
Did you feel that you were sincerely cared for during the physical exam? |
Yes |
29 (63.0) |
||||
|
Somewhat |
16 (34.8) |
||||||
|
No |
1 (2.2) |
||||||
|
Q5 |
Could you tell the doctor/nurse about your true concerns about treatment? |
Yes |
29 (63.0) |
||||
|
Somewhat |
12 (26.1) |
||||||
|
No |
5 (10.9) |
||||||
|
Q6 |
Did the doctor/nurse explain the diagnosis and treatment plan clearly? |
Yes |
29 (63.0) |
||||
|
Somewhat |
12 (26.1) |
||||||
|
No |
5 (10.9) |
||||||
|
|
|
|
|||||
|
Q7 |
Were you satisfied with the medical care you received? |
Yes |
32 (69.6) |
||||
|
Somewhat |
12 (26.1) |
||||||
|
No |
2 (4.3) |
||||||
|
Questions about surprising points |
|||||||
|
Q8 |
What aspects of your medical care in Japan was most surprising or different from your country? |
Top 3 Answers |
No. (%) |
||||
|
|
Different treatment plan |
7 (14.0) |
|||||
|
|
Lack of explanation by medical staffs |
6 (12.0) |
|||||
|
|
No privacy in the examination room |
6 (12.0) |
|||||
Table 3: Result of the survey of foreign residents
C. Scenario Development
Based on the survey results, we decided the main topic of the scenarios based on the contents overlapped in multiple cases. “Gender restriction of doctors who treated patients” and “communication difficulty in languages other than Japanese or English” were the most frequent topics in cultural and linguistic difficulties respectively. Following the selection of topics, we synthesised the similar responses to create a scenario that could occur in any size of ED setting. We developed the settings including patient age, sex, language, and backgrounds, regarding that the patient characteristics can be demonstrated by simulated patients. As a result, we developed two scenarios: a scenario of abdominal pain in a Muslim female patient and a scenario of forearm fracture in a Chinese male patient (Appendices 5 and 6). In the abdominal pain scenario, no female doctor was available, and a learner, a male doctor, had to examine and treat a simulated patient who refused to be seen by a male doctor. In the forearm fracture scenario, no interpreter was available, and a learner had to communicate with a simulated patient who spoke Chinese only. The learning objective for the learners was to communicate appropriately with patients with different cultural and linguistic backgrounds. Based on the results of the survey for foreign residents, we indicated the importance of listening to the patient’s concerns carefully as a teaching point. Also, we reflected the survey results of how each hospital handled the cases on the information for instructors and teaching points.
IV. DISCUSSION
At the time of writing this paper, 96.5% of the EDs had accepted foreign patients; and 82.3% had English-speaking staff. However, only 32.6% of the EDs had multilingual signs for patients, which is listed as actions to be taken in the manual for treating foreign patients (Japan Ministry of Health, Labour and Welfare, 2021).
In the present study, most of the EDs used translation tools when treating foreign patients. Various types of translation methods were found to be used in the EDs, the use of which is consistent with the manual for treating foreign patients (Japan Ministry of Health, Labour and Welfare, 2021). However, we found that the EDs still encountered a significant number of cases with linguistic difficulties. This suggests that even though the EDs own the translation tools, medical staff are not able to utilise them in communicating with foreign patients. According to our survey result, it was revealed that more than half of the cases with linguistic difficulties were of non-English speaking patients. To overcome the linguistic difficulties, medical staff need to be capable of using them enough to communicate with patients of various native languages. In addition to the use of translation tools, multilingual medical explanation/consent forms or signs in hospitals may be effectively used in the aim of communication with foreign patients.
Regarding culturally difficult cases, our survey showed the various issues caused by differences of religious background, lifestyles, and ideas and beliefs on treatment and testing between medical staff and patients. This result is consistent with the reports which elaborated difficulties in treating foreign patients in Japan (Tatsumi et al., 2016). Our study showed that different ideas/beliefs towards treatments or examinations was most common theme in the cases with cultural difficulties in EDs. Knowing beliefs of other culture is one of individual’s capabilities to manage effectively in culturally diverse settings (Ang et al., 2007), and a report on psychiatric hospitals showed that medical staff adapted to hospitalised foreign patients’ culture and religion as they built the relationships with the patients over a long period of time (Kobayashi et al., 2014). Whereas, it is difficult to build relationships with foreign patients in the acute ED setting. Thus, we realised that practical training of communication with foreign patients provide knowledge about their cultures and religions in limited time and is critically important for medical staff in EDs.
SBE is an effective educational format which makes learners’ unconscious incompetence to conscious incompetence (Morell et al., 2002), in other words, medical staff may be able to recognise their unconscious biases towards foreign patients by participating in SBE. As consistent with the previous survey by the MHLW (2021), the culturally difficult cases included complicated issues that require the cooperation of administrative staff and full-time English interpreters in the hospital. In the present study, we created the two scenarios targeting medical staff as learners based on the real-life cases with the many responses in the survey. However, we need to create more varieties of scenarios that can involve other professions than health care professionals. Furthermore, the acquisition and retention of learners’ skills in a single training session of SBE is limited (Legoux et al., 2021). SBE aimed at cultivating cultural awareness cannot be completed in a single session but in continuous sessions with multiple scenarios.
The results of our survey of foreign residents showed that they had been surprised at the differences in treatment plans between their country and Japan, a lack of explanation by medical staff, and a lack of privacy in the examination room. We found that it is important to investigate the opinions of those who receive medical care in a country different from their home because their perspectives allow us to recognise the things taken for granted among medical staff. Medical staff’s unconscious biases about patients of different cultural backgrounds or national origins influence their decision-making (Tervalon & Murray-Garcia, 1998), and implicit bias can contribute to miscommunication (Bartlett et al., 2019). Therefore, listening to the concerns of foreign patients is important in order to avoid providing treatment based solely on medical staff’s biases. Furthermore, in creating scenarios, referring to the survey results of multiple stakeholders made the contents more multi-dimensional and relevant. This study was conducted in the contexts of EDs in Japan, however, scenarios created with perspectives of both medical staff and patients who have various cultural backgrounds may effectively address to the real-life problems triggered by unconscious biases, even in other contexts.
In Emergency situations, we often focus on the patients’ cultural backgrounds, national origins, languages, and religious background in order to provide effective treatments. However, recognising our own bias is not achieved by only focusing on the patients’ culture. Self-reflection is necessary to recognise one’s own cultural biases. The process of self-reflection of our own culture is important for cultivating cultural awareness. Furthermore, the importance of cultural humility – discovering one’s own values toward other cultures through continuous self-reflection and becoming aware of one’s own relationship to the world – has been recently noted in medical education (Chang et al., 2012). As a further research, the development of scenarios that include the study guide which ensure the learners’ self-reflection is required for SBE in emergency settings.
There are several limitations in this study. The response rate of a survey for EDs was 30.9%, which is unable to deny sampling bias. We conducted a survey for EDs with a focus on English, however, it is necessary to conduct surveys on languages other than English. In addition, the survey was only for the EDs of training hospitals in the top 10 prefectures with the most foreign tourists. We may consider expanding the number of hospitals to collect more information about difficulties they encounter in treating foreign patients. For the sub study, the snowball sampling had a methodological limitation in calculating total number the survey sent. As a further research, impacts of SBE using these scenarios on the treatment of foreign patients is less clear. To assess whether foreign patients’ satisfaction of medical care will change, and whether unconscious bias towards foreign patients among medical staff will decrease by conducting these scenarios are necessary.
V. CONCLUSION
In the current study, we were able to clarify linguistic and cultural difficulties in treating foreign patients in the EDs. We developed the scenarios for SBE using the real-life difficult cases of foreign patients with linguistic or cultural differences in medical care in Japan. The simulation training using these scenarios may be useful for promoting cultural awareness of medical staff in EDs. In future, more varieties of scenarios of SBE need to be created and shared in order to treat foreign patients safely and adequately.
Notes on Contributors
SO contributed to the design of the study and conducted data collection and analysis. RA devised the project, the main conceptual ideas, and conducted data collection and analysis. ST contributed to the design of the study and the interpretation of the data.
Ethical Approval
This study was approved by the Institutional Review Board of The Jikei University School of Medicine Japan (Approval No. 28-211(8454), 28-276(8519)). An informed consent was obtained from all the participants responded to the survey.
Data Availability
The data that support the findings of this study are not openly available due to privacy. The materials are available from the corresponding author on reasonable request.
Acknowledgement
The authors would like to acknowledge the respondents at the EDs of training hospitals, the foreigners living in Japan, and the young clinicians at The Jikei University School of Medicine for their cooperation in the study.
Funding
This work has been supported by JSPS KAKENHI, grant number 16K08883.
Declaration of Interest
The authors report no conflicts of interest. The authors alone are responsible for the content of the article.
References
Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. (2007). Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and Organization Review, 3(3), 335-371. https://doi.org/10.1111/j.1740-8784.2007.00082.x
Ashida, R., & Otaki, J. (2022). Survey of Japanese medical schools on involvement of English-speaking simulated patients to improve students’ patient communication skills. Teaching and Learning in Medicine, 34(1), 13-20. https://doi.org/10.1080/10401334.2021.1915789
Bartlett, K., Strelitz, P., Hawley, J., Sloane, R., & Staples, B. (2019). Explicitly addressing implicit bias in a cultural competence curriculum for pediatric trainees. MedEdPublish, 8. https://doi.org/10.15694/mep.2019.000102.1
Chang, E. S., Simon, M., & Dong, X. (2012). Integrating cultural humility into health care professional education and training. Advances in Health Sciences Education, 17(2), 269–278. https://doi.org/10.1007/s10459-010-9264-1
Hobgood, C., Sawning, S., Bowen, J., & Savage, K. (2006). Teaching culturally appropriate care: a review of educational models and methods. Academic Emergency Medicine, 13(12), 1288-1295. https://doi.org/10.1197/j.aem.2006.07.031
Japan Ministry of Economy, Trade and Industry. (2019, January). Kokunai iryokikan ni okeru gaikokujin kanja no ukeire jittai chosa [Survey on the actual conditions of foreign patients accepted at domestic medical institutions in Japan]. https://www.meti.go.jp/policy/mono_info_service/healthcare/iryou/inbound/activity/survey_report.html
Japan Ministry of Health, Labour and Welfare. (2021, March). Gaikokujin kanja no ukeire no tameno iryokikan muke manyuaru [A manual for medical institutions to accept foreign patients]. https://www.mhlw.go.jp/content/10800000/000795505.pdf
Japan Tourism Agency. (2018, February). Shukuhakuryoko tokeichosa hokokusho [Report on the survey of accommodations and travel statistics]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/common/001220398.pdf
Japan Tourism Agency. (2019, March). Honichi gaikokujin ryokosha no iryo ni kansuru jittaichosa ukeire kankyo no seibikyoka wo okonaimashita [Conducted a survey on the actual conditions of medical care for foreign visitors to Japan and strengthened the development of the receiving environment]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/kankocho/news08_000272.html
Japan Tourism Agency. (2021, June). Shukuhakuryoko tokeichosa [Survey of accommodations and travel statistics]. Ministry of Land, Infrastructure, Transport and Tourism. https://www.mlit.go.jp/kankocho/siryou/toukei/content/001413644.pdf
Kelly, M. A., Balakrishnan, A., & Naren, K. (2018). Cultural considerations in simulation-based education. The Asia Pacific Scholar, 3(3), 1-4. https://doi.org/10.29060/TAPS.2018-3-3/GP10 70
Kobayashi, Y., Yoshimitsu, Y., & Kato, S. (2014). Super kyukyu ni okeru kangoshi no gaikokujinkanja nitaishite ninshiki suru mondai to taio no jissai [Nurses’ perceptions of and responses to foreign patients in a super emergency hospitals]. Nihon Seishinka Kango Gakujutsu Shukaishi [The Japanese Psychiatric Nursing Society], 57(3), 379 383.
Kubo, Y., Takaki, S., Nomoto, Y., Maeno, Y., & Kawaguchi, Y. (2014). Nihon no byoin ni okeru kyukyugairai deno gaikokujinkanja heno kango no genjo ni kansuru chosa. [A survey on the current status of nursing care for foreign patients in emergency departments in Japanese jospitals]. Kosei no shihyo [Journal of Health and Welfare Statistics], 61(1), 17-25.
Leake, R., Holt, K., Potter, C., & Ortega, D. M. (2010). Using simulation training to improve culturally responsive child welfare practice. Journal of Public Child Welfare, 4(3), 325-346. https://doi.org/10.1080/15548732.2010.496080
Legoux, C., Gerein, R., Boutis, K., Barrowman, N., & Plint, A. (2021). Retention of critical procedural skills after simulation training: a systematic review. AEM Education and Training, 5(3), e10536. https://doi.org/10.1002/aet2.10536
Mechanic, O. J., Dubosh, N. M., Rosen, C. L., & Landry, A. M. (2017). Cultural competency training in emergency medicine. The Journal of Emergency Medicine, 53(3), 391-396. https://doi.org/10.1016/j.jemermed.2017.04.019
Morell, V. W., Sharp, P. C., & Crandall, S. J. (2002). Creating student awareness to improve cultural competence: creating the critical incident. Medical Teacher, 24(5), 532-534. https://doi.org/10.1080/0142159021000012577
Motola, I., Devine, L. A., Chung, H. S., Sullivan, J. E., & Issenberg, S. B. (2013). Simulation in healthcare education: a best evidence practical guide. AMEE Guide No. 82. Medical Teacher, 35(10), e1511-e1530. https://doi.org/10.3109/0142159X.2013.818632
NHS England. (2016). NHS England response to the specific duties of the Equality Act. Equality information relating to public facing functions. https://www.england.nhs.uk/wp-content/uploads/2016/02/nhse-specific-duties-equality-act.pdf
Office of Disease Prevention and Health Promotion. (2021, August). Disparities. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. https://www.healthypeople.gov/2020/about/foundation-health-measures/Disparities
Osegawa, M., Morio, H., Nomoto, K., Nishizawa, M., & Sadahiro, T. (2002). Present medical practice and problems in emergency disease in foreign travelers requiring hospital admission. Nihon Kyukyu Igakukai Zasshi [Journal of Japanese Association for Acute Medicine], 13(11), 703-710. https://doi.org/10.3893/jjaam.13.703
Paroz, S., Daele, A., Viret, F., Vadot, S., Bonvin, R., & Bodenmann, P. (2016). Cultural competence and simulated patients. The Clinical Teacher, 13(5), 369-373. https://doi.org/10.1111/tct.12466
Serizawa, A. (2007). Developing a culturally competent health care workforce in Japan: implications for education. Nursing education perspectives, 28(3), 140-144.
Seropian, M. A. (2003). General concepts in full scale simulation: getting started. Anesthesia & Analgesia, 97(6), 1695-1705. https://doi.org/10.1213/01.ane.0000090152.91261.d9
Tatsumi, Y., Sasaki-Otomaru, A., & Kanoya, Y. (2016). The actual situation and issues of emergency medical services for foreigners staying in Japan extracted by systematic review. Nihon Kenko Igakukai Zasshi [Journal of Japan Health Medicine Association], 25(2), 91-97.
Tervalon, M., & Murray-Garcia, J. (1998). Cultural humility versus cultural competence: A critical distinction in defining physician training outcomes in multicultural education. Journal of Health Care for the Poor and Underserved, 9(2), 117-125. https://doi.org/10.1353/hpu.2010.0233
*Sayaka Oikawa
Center for Medical Education and Career Development,
Fukushima Medical University,
1 Hikarigaoka, Fukushima, 960-1295, Japan
Email: sayaka9@fmu.ac.jp
Submitted: 11 February 2022
Accepted: 21 July 2022
Published online: 4 April, TAPS 2023, 8(2), 4-13
https://doi.org/10.29060/TAPS.2023-8-2/OA2755
Tri Nur Kristina1, Fatikhu Yatuni Asmara2, Sudaryanto Sudaryanto1, Nuryanto Nuryanto3 & Saekhol Bakri1
1Department of Medicine, Faculty of Medicine, Universitas Diponegoro, Indonesia; 2Department of Nursing, Faculty of Medicine, Universitas Diponegoro, Indonesia; 3Department of Nutrition, Faculty of Medicine, Universitas Diponegoro, Indonesia
Abstract
Introduction: This study aimed to examine the usefulness of Community Based-Education (CBE) and Interprofessional Education (IPE) to community health outcomes.
Methods: The design was a mixed-method study. Each small group worked together to identify family health problems, implement interventions, and evaluate the results. The Readiness for Interprofessional Learning Scale (RIPLS) questionnaire was applied to compare students’ perceptions before and after the implementation. In addition, qualitative data were acquired from students’ comments on the questionnaire, interviews with community representatives, and FGDs with instructors at the end of the program.
Results: Three hundred and sixty-seven out of 465 students returned the completed paired questionnaire (78.9 % response rate). Paired t-test showed that student perception of responsibility slightly increased, whereas teamwork and collaboration, negative and positive professional identity decreased somewhat. However, most pre-post students’ responses already trended to the positive side (scales 4 and 5). Moreover, the Chi-square test showed that pre-post students’ confidence levels significantly increased. Most small groups of students successfully empowered the community to solve health problems. Students, instructors, and representatives of community members appreciated the program. However, several students felt their instructors were not motivated to mentor their tasks, and sometimes they had difficulty conducting home visits together.
Conclusion: This study showed that the combination of CBE-IPE contributes to more favourable community health outcomes. However, it was challenging in several aspects of preparation, including highly motivated instructors. Nevertheless, pre and post-implementation students’ attitudes are still positive.
Keywords: Interprofessional Education (IPE), Community Based Education (CBE), Health Profession Students, Readiness
I. INTRODUCTION
Community-based education (CBE) programs for medical and other health professionals expose students to community health problems, in which they will work in the future as health professionals. However, the CBE program is usually implemented within a single discipline, whereas community health problems must be solved collaboratively among a health care team (Housley et al., 2018).
Interprofessional Education (IPE) has been identified as a valuable method of learning experiences to increase the collaboration and communication of health professionals in healthcare settings. Several studies have reported positive student perceptions of IPE, including improved patient and community outcomes (Dynes et al., 2013). For example, the Leicester Model of IPE demonstrated that students and healthcare professionals gain valuable insights into the balance task of patient-related issues and offer clarity about the effectiveness of collaborative opportunities in addressing patients’ needs (Lennox & Anderson, 2012). Carr (2015) also reported that after the IPE experience, students perceived strong confidence in communication with other professions, increased knowledge of the importance of teamwork and collaboration, learning professional roles, respecting other professional points of view, and improved communication skills.
The goal of undergraduate education for students in the health professions is mainly to produce graduates who can solve community health problems and increase community health, particularly in primary health care. Moreover, community health problems should be solved collaboratively. Thus, Community Based Education (CBE) combined with IPE is needed to be implemented in health professions schools. Several studies have implemented IPE in the community and positively affected students. For example, a study in the Philippines showed the usefulness of the IPE in the community, such as: learning about collaboration, appreciation of roles, holistic care, service to the community, and unique learning experience (Opina-Tan, 2013). A qualitative study in Australia also concluded that students who were voluntarily involved in an IPE program appreciate the opportunity to have direct practice experience in a community context and see this as a valuable way of engaging in interprofessional learning (Stewart et al., 2015). Furthermore, Wagner et al. (2011) stated that IPE in the community improved teamwork.
However, the IPE implementation in community-setting in Indonesia is not yet promising. Lestari et al. (2020) reported that communication and mutual support were problems faced by students. Furthermore, Randita et al. (2019) also stated that collaborative patient-centred competence has a moderate effect when IPE is implemented in the community setting. Therefore, IPE in Indonesia needs further exploration, especially when it is implemented in the community setting with a large number of students who are not volunteers but are obliged to be involved in such programs. In addition, it is anticipated that a learning model combining CBE and IPE will have additional benefits in supporting community health. Thus, the research question of this study was, is the combination of CBE-IPE valuable on community health outcomes, and what are the students’ attitudes and perceptions towards the new program?
II. METHODS
A. The Combination CBE-IPE Model
Before implementation, we matched the curricula of three health professions study programs (Medicine, Nursing, and Nutrition) at the Faculty of Medicine Universitas Diponegoro (a government medical school in Semarang, Indonesia). Based on the acquired competencies and timing possibility, we agreed that the new CBE-IPE program should be implemented for students in the 6th semester. In the 6th semester, all 465 health professions students (212 medical students, 127 nursing students, and 126 nutrition students) participated in this program during one semester.
Before implementation, we discussed with the head of the district health office and the director of the community health centre (CHC) to receive suggestions related to this program, especially in conjunction with the population health situation. As a result, we agreed that students should be assigned to families with pregnant women to support the local government health program in reducing maternal mortality. Thirty-six cadres (voluntary community members) were requested to participate in the project by the director of the CHC and agreed to help them in the program implementation. All cadres had been trained to conduct simple health promotion by the CHC.
A total of 465 health professions students were divided into 126 small groups consisting of 1-2 medical and nursing students and one nutrition student. One small group was attached to one family with a pregnant woman. To have experiences with a continuum of care, small groups of students added one other family if the first family had no children or elderly. Students had to work together to measure the health status of all family members, identify health problems, and propose a solution for identified health problems in discussions with their instructors. Based on those discussions, the students worked collaboratively with the cadres to implement collaborative interventions and eventually evaluated the result of their interventions. During this implementation, groups of students presented their work three times in seminars attended by all instructors and coordinators from three departments. The head of CHC received final reports for follow-up.
B. Study Design and Subjects
The design of this study was a mixed-method study to combine quantitative and qualitative data, in which the qualitative data was used to enrich the quantitative ones. Quantitative data was acquired by asking all students (465 health professions students) to fill out questionnaires before and after implementing the CBE-IPE program. We used the Readiness for Interprofessional Learning Scale (RIPLS) to evaluate students’ perceptions. This questionnaire has been widely used to collect students’ attitudes and perceptions to measure the readiness of healthcare professional students to undertake shared learning activities (Hertweck et al., 2012; Parsell & Bligh, 1999). Negative professional identity items represented negative statements regarding the value of working with other healthcare students. Therefore, this study reversed scored items so that high scores indicated IPE readiness (McFadyen et al., 2006). We used RIPLS in the Indonesian language version, which was developed by Tyastuti et al. (2014). It used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The EFA accounted for 59.9% of the total variance, while the alpha coefficient of CFA was > 0.7. Furthermore, construct validity was acceptable goodness of fit. Thus, the RIPLS in the Indonesian language version is a valid tool to assess students’ attitudes toward IPE.
The qualitative data were gained by collecting student comments in the questionnaire by asking: “Please write your words regarding this new program.” Moreover, TNK conducted interviews one by one with representatives of community members: two housewives and three cadres. At the end of the program, we conducted a workshop, including two times FGD conducted by TNK, FYA, and SB with 16 instructor’s representatives. Verbatim of all qualitative data was completed by TNK. The result of students’ intervention for patients and families was identified from students’ reports.
C. Data Analyses
We described the student’s characteristics and the result of student intervention on community outcomes. Paired-sample t-tests were used to compare the pre-post students’ responses to RIPLS. In addition, students’ perceptions related to self-confidence before and after the implementation were compared using chi-square. SPSS v22 was used to analyse the quantitative data. The students’ comments and interviews with community member representatives and instructors were analysed using content analysis according to Braun and Clarke (2006). First, keywords were identified as codes, and we used a matrix consisted three columns, namely keywords, categories, and themes. TNK and FYA conducted qualitative data analysis. Different coding was discussed to reach a consensus.
D. Ethical Consideration
We verbally explained this study to all participants before collecting the data. Especially for students, we guaranteed that their perceptions would not affect their scores. Then, we asked for participants’ agreement to join this study by signing the informed consent. The author would confidentially keep their identity.
III. RESULTS
Three hundred and sixty-seven out of 465 students returned the completed paired questionnaire (78.9 % response rate). Table 1 shows the subject’s characteristics of this study.
|
No |
Subject’s characteristics |
Categories |
Quantity |
Percentage |
|
1. |
Students (n= 367) |
|||
|
The study program |
Medicine |
167 |
45.4 |
|
|
Nursing |
100 |
27.3 |
||
|
Nutrition |
100 |
27.3 |
||
|
Gender |
Male |
73 |
20 |
|
|
Female |
294 |
80 |
||
|
2. |
Instructors (n: 16) |
|||
|
The study program |
Medicine |
6 |
38 |
|
|
Nursing |
5 |
31 |
||
|
Nutrition |
5 |
31 |
||
|
Gender |
Male |
4 |
25 |
|
|
Female |
12 |
75 |
||
|
Age |
31-40 |
6 |
37 |
|
|
41-50 |
10 |
63 |
||
|
3 |
Representative of community members |
|||
|
Age |
30-40 |
3 |
60 |
|
|
41-50 |
2 |
40 |
||
|
Gender |
Male |
0 |
0 |
|
|
Female |
5 |
100 |
||
Table 1. Characteristics of study subjects
A. The Result of Students’ Intervention in the Community Outcomes
Various health problems were identified and successfully managed by the students in collaboration with cadres (Table 2 and 3). Students also recognised that most families with low social-economic status and little education did not have health insurance. The head of the CHC agreed to follow up on some parts of the identified health problems, such as visiting pregnant women with high risk to ensure that they will deliver in the hospital, giving intervention for malnutrition toddlers, and vitalizing the post-health for the elderly.
|
No |
Problems identified |
Students’ interventions |
Results
|
|
1 |
One pregnant woman with an abortion |
Students and cadre provided education and accompanied the mother to the hospital. |
a. The mother should be curettage by the doctor in the hospital. b. The mother healthy and agrees to postpone the next pregnancy. |
|
2 |
Only 20% of pregnant women without risk factors who follow gymnastic program in CHC |
Motivation to follow gymnastic for pregnant women |
Moderate-high compliance
|
|
3 |
About 40% of pregnant women have low knowledge about monitoring of pregnancy and low compliance with routine ANC |
Direct education and gave motivation |
Increasing knowledge and compliance for ANC |
|
4 |
25.4% of pregnant women with risk factors according to the standard of WHO and 0.04% with high risk |
Motivation to routinely ANC and monitoring |
High compliance |
|
5 |
42.1% of pregnant women do not have health insurance |
Education to apply government health insurance |
25% have insured key person agrees to follow up |
|
6 |
Social and cultural problem (do not want to eat fish) |
Direct education |
Moderate-high compliance |
|
7 |
83.3% of pregnant women not enough nutrition in their daily diet (2 days recall) |
Gave leaflet and an example of healthy food |
Moderate-high compliance |
|
8 |
20% of pregnant women with anemia)
|
Gave Fe from CHC or midwives. |
Low compliance (reason: not good taste and felt nausea) |
Table 2. Students’ work-related pregnant women in the community
|
No |
Problems identified |
Students’ interventions |
Results
|
|
Baby and Toddlers |
|||
|
1 |
10% with malnutrition |
Education to mother and giving an example of healthy food |
Head of CHC followed up based on student’s report |
|
2 |
Acute Respiratory Infection |
Education and Suggested to CHC |
Cured |
|
3 |
Diarrhoea |
Education and Suggested to CHC |
Cured |
|
4 |
Motoric low development |
Education and Suggested to CHC |
Still to be followed up |
|
5 |
Difficult to eat, low knowledge of mother about healthy food |
Education to mother and give an example of healthy food |
Increasing knowledge |
|
6 |
One child with hydrocephalus |
Motivation to go to the hospital and finding the agency of hydrocephalus |
Has been tackled by the agency of hydrocephalus |
|
Puberty |
|||
|
1 |
Low knowledge about reproductive health |
Direct education |
Increasing knowledge and Head of CHC agree to follow up |
|
2 |
Smoking habit & Narcotic consumption |
Direct education |
|
|
3 |
Anemia among girl |
Direct education |
|
|
Adult |
|||
|
1 |
Low knowledge of occupational accident |
Direct education |
Increasing knowledge |
|
2 |
Low knowledge about family planning |
Direct education |
Increasing knowledge |
|
Elderly |
|||
|
1 |
Hypertension, Knee osteoarthritis, DM type II, Low Back Pain, Stroke, Low quality of life due to osteoarthritis and LBP |
Education and Suggestion to routinely to CHC |
Have been followed up by CHC
|
|
2 |
Only 15% routinely come to the integrative post health for elderly |
Education and Motivation |
Low compliance
|
Table 3. Students’ work with other family members
B. Pre-post Comparison of Students’ Perceptions
Students’ perceptions using RIPLS (5-point Likert scale) from all study programs showed a slight decrease in team collaboration, professional identity, and the cumulative sub-scale. Only student perception of responsibility slightly increased (Table 4). However, most pre-post students’ responses to the RIPLS questionnaire already trended to the positive side (scales 4 and 5). Comparison of pre-post students’ self-assessment of their confidence level significantly increased (Table 5).
|
No |
Subscale |
Pre Mean ± SD |
Post Mean ± SD |
P |
|
1 |
Teamwork & Collaboration |
38.96 ± 3.2 |
36.93 ± 4.0 |
< 0.001* |
|
2 |
Negative professional identity |
6.01 ± 2.4 |
5.29 ± 1.9 |
< 0.001* |
|
3 |
Positive Professional identity |
20.91 ± 1.9 |
20.23 ± 2.5 |
< 0.001* |
|
4 |
Role of responsibility |
5.38 ± 1.3 |
5.56 ± 1.5 |
0.07 |
|
5 |
Total subscale |
70.57 ± 5.0 |
68.74 ± 5.9 |
< 0.001* |
Table 4. Comparison of all students’ perception using RIPLS pre and post implementation (n: 367)
*Significance (p < 0.05) with paired t test
|
No |
Level of Confidence |
Pre |
Post |
Sig |
|
1 |
Not so confident |
69 (18.8%) |
3 (0.8%) |
< 0.00* |
|
2 |
Confident |
272 (74.1%) |
281 (76.6%) |
|
|
3 |
Very confident |
26 (7.1%) |
83 (22.6%) |
Table 5. Level of students’ Confidence (N: 367)
*Significance (p < 0.05) with chi-square test
C. Students’ Comments
Only 141/367 (38%) students wrote their comments in the questionnaire. However, most students (94% of 141 students) appreciated this program and suggested it be continued.
“The program is good; it can help community member to solve their health problem”
F23Nurs
“I agree if the program will be continued”
F50Nurs
Positive aspects raised by the students were:
- Opportunity to have direct communication with the community member (68%),
“I have the opportunity to communicate directly with patients and family, which is difficult to do when I’m only studying in the class”
M13Med
- Understanding each other when exploring and sharing knowledge to solve the identified health problems (32%),
“I feel amazed that each of us has our roles in solving health problems”
F67Med
- Learning about health team collaboration in the actual situation (40%),
“I learn a lot about how to collaborate with other health students in the real situation”
F90Nut
- Feeling proud that they had the opportunity to contribute to managing community health problems (69%).
“This program gives me an opportunity to collaborate with other professions to solve community health problems”
F44Nurs
The student’s complaints were as follows:
- Their task of working with a continuum of care was too heavy and exhausting.
“Focus on one family problem for one small team would be more useful.”
F57Med
- Several students (13%) also felt that their instructors were not motivated to mentor their tasks.
“It is difficult to make an appointment with the instructors, so we don’t have enough time to get feedback from him”
F21Med
- They had difficulty conducting home visits together (73%).
“Our biggest problem is matching the schedule to do a home visit.”
M98Nut
D. Interviews with Representatives of Community Members (two housewives, three cadres)
Both housewives and cadres appreciated the students’ work. They believed the students already had enough competencies to help their health problems. Cadres were still committed to participating in the following program and working with the students to implement, monitor, and evaluate the intervention.
“We are so happy that students help us a lot to identify and to solve our health problems”
F01HW
“Yes, of course, we will help students to communicate with the family as well as report the result of students’ intervention to Community Health Centre”
F03C
Community members thought they were not receiving enough information about the students’ purpose for visiting their house. They suggested that the cadre should have explained to them this program. However, they welcomed the students and told them to make an appointment before the home visit.
“There was no information from cadres of CHC that students will come to our house, but we still welcoming the students because it gives many benefits for us”
FHW02
E. FGD with Instructors at the End of the Program
Most instructors (94,5%) appreciated the value of this program. However, they needed more detailed information about the program, especially assessing students. They also thought it was too hard for students to add one family after already concentrating on one family’s health problem. They agreed that a tiny group should only be attached to one family with a pregnant woman. To strengthen collaboration competencies, all groups of students should implement a “collaborative intervention” that involves all disciplines.
“Sometimes students implemented their intervention within a single discipline that they thought more appropriate to solve the specified health problem.”
F05Inst
The instructors suggested that the assessment include peer assessment to increase students’ attitudes toward valuing each other. It was finally agreed that in the next implementation, various types of assessment would be implemented, namely students’ activities, presentation and discussion, peer assessment, and students’ assessment by the family members.
“Various assessment methods are preferable to capture students’ performance from the different side”
M09Inst
IV. DISCUSSION
This study aimed to examine the impact of implementing the CBE-IPE model on the outcomes of student intervention in the community and students’ attitudes and perceptions towards the new program. Within the CBE-IPE program, the health professions students successfully worked together to empower the community to solve most community health problems. The CBE-IPE program aims to give health profession students direct experiences in working as a health team in dealing with community health problems that might correlate with the social and economic backgrounds of community members. In this study, students identified several health problems in the family with low financial status, low education, and did not have any health insurance. Hence, the health profession students within this program also had an opportunity to learn several principles, including the level of education and economic aspects when implementing their interventions. It is in line with the study by Ngo et al. (2021), who reported that hypertension and cardiovascular risk could be identified by conducting CBE-IPE in homeless adults.
We implemented the CBE-IPE program without any serious obstacles due to the support from the local health government and the director of CHC. Cadres and representatives of community members also commented that the students’ presence and work were beneficial. They stated that they would be involved in the program and work with students to implement, monitor, and evaluate the result. It is important to involve cadres in this program because they will handle the follow-up under the supervision of CHC. Some studies also involved non-health workers in IPE implementation, such as Akter et al. (2016), who involved lay health workers, and Dynes et al. (2013), that involved health extension workers and community health promoters in improving maternal and neonatal health outcomes.
A. Students’ Attitudes and Perceptions Toward the CBE-IPE Program
This study showed that students’ attitudes and perceptions toward this program have improved, especially regarding the role of responsibility and confidence level. In this study, students have tasks to implement health intervention after discussing health problems identified with their instructor, which might increase their commitment and confidence. Tan et al. (2021) also demonstrated the importance of feedback and discussion, in which IPE participants noted that the debriefing process improves their compliance and teamwork.
Students’ perceptions as assessed by the RIPLS in aspects of team collaboration and interprofessional identity were slightly lower, although statistically significant. These statistically significant differences might result from the large sample size of this study. Several studies have shown that one-time IPE implementation is unlikely to change attitudes, whereas multiple or longitudinal IPE experiences elicit attitudinal change with a more positive response (Hammick et al., 2007; Pollard et al., 2006). Hind et al. (2003) reported little to no change in the health professions students’ perception of the RIPLS between pre-and post-implementation. Schreiber et al. (2014) also reported a slight increase and no statistically significant differences in the pre-post response to the RIPLS because the students already had positive attitudes toward IPE. Torsvik et al. (2021) reported that RIPLS tends to have a ceiling effect. Therefore, RIPLS no longer seems suitable for measuring and evaluating the impact of interprofessional learning. In this study, “most pre-post students’ responses to the RIPLS questionnaire already trended to the positive side.” Thus, the RIPLS also possibly has a ceiling effect in this study.
B. Wrapped up CBE-IPE Program Evaluation
Evaluation of this initial program demonstrates that students felt favourable toward the CBE-IPE program and felt more confident when dealing with community health problems. In line with Wong et al. (2018) study, the final students of six health programs have a positive attitude towards working together in an interprofessional health care team.
Nevertheless, students also complained that their tasks in working within a continuum of care were too heavy. As a result, they felt exhausted and less motivated to identify other health problems in another family. This complaint was in line with the instructors’ opinion. It concurred that students could learn from each other when they presented and discussed their work in the seminar. The recommendations included an adjustment in the tasks, scheduling, and improvements in the communication and quality of supervision. Therefore, the students’ tasks must be adjusted to accommodate these suggestions in the following implementation. Sunguya et al. (2014) reported that curriculum is an essential challenge in implementing IPE, which is in line with the study conducted by Thistlethwaite (2012) and Herath et al. (2017), which states that teaching methods and learning activities can be problems faced when implementing IPE. Furthermore, scheduling is one of the problems faced by faculty who implement the IPE program (Ngabonzima et al., 2020)
The instructors mentioned that the students’ interventions were not always “collaborative disciplines” since sometimes only a single discipline intervention for some health problems, and very little content was contributed by the other students in the specified group. Therefore, these circumstances might influence the lower perception of negative professional identity after the program implementation (Hind et al., 2003). Milot et al. (2015) also reported that it could sometimes be challenging to combine heterogeneous student teams during the learning together phase, where every discipline should be represented.
Understanding the attitudes of health professional students and the factors that influence their perceptions, including the situation they face during implementation, may help implement the program in several stages. There are four levels for the students to join the interprofessional collaborative practice. These include level 1: intra-professional education: the foundation of group skills, level 2: introduction to interprofessional education and collaboration: exposure to the healthcare team, level 3: interprofessional collaboration, and level 4: becoming an influential member of the healthcare team (Salfi et al., 2012).
C. Limitations
This study’s limitation lies in the type of data collection that only uses a closed-ended questionnaire and asks the students to write their comments on the program. Although the students raised several positive attributes, this study did not obtain sufficient information about what happened during the implementation and what was behind the students’ rated aspects. Therefore, FGDs with students are still needed to understand program implementation in-depth. Further, direct participation in program implementation might identify obstacles regarding when students should collaborate in their intervention program. Additionally, limitations in this study are acknowledged as data were collected from less than 80% of students participating in the program. Finally, no formal feedback was collected from the community members, although verbal input in the interview was positive. A collection of more detailed data would have provided a deeper understanding of the program’s impact on community perceptions.
We realize that implementing the CBE-IPE program in the community, which involves many students, was challenging and needed more careful preparation. Moreover, the lecturers’ motivation might be increased by encouraging and facilitating them to include field epidemiology research in the same area, with research funding from the faculty. Several changes should be made based on this evaluation, including more detailed guidance for the students and instructors.
V. CONCLUSION
This study revealed that the combination of CBE-IPE for 6th-semester health profession students had been perceived as a valuable learning experience to build community health. Nevertheless, it was challenging for many students in several aspects of the preparation. Moreover, highly motivated lecturers are required, which might be increased by encouraging and facilitating field epidemiology research in the same area. Finally, further research is needed to explore students’ experiences during implementation, primarily how they work as a team and their belief in professional identity. It is also important to identify the result of a combination of CBE-IPE implementation in terms of the satisfaction of students, instructors, and family members.
Notes on Contributors
Tri Nur Kristina conceptualised and designed the research, participated in the analysis and intepretation of data, drafted and revised the manuscript, and giving final approval of the version to be published.
Fatikhu Yatuni Asmara conceptualised of the program implementation, participated in the data collection, and revised the manuscript.
Sudaryanto conceptualised of the program implementation.
Nuryanto conceptualised of the program implementation and participated in the data collection.
Saekhol Bakri conception of the program implementation and participated in the data collection.
Ethical Approval
The Medical and Health Research Ethics Committee (MHREC), Faculty of Medicine Diponegoro University-Dr. Kariadi General Hospital had approved this study (No. 519/EC/FK/2020).
Data Availability
Author could not share the data of this study widely because of its privacy. It also contains qualitative data.
Acknowledgement
The authors would like to thank the Faculty of Medicine Universitas Diponegoro for providing the funding for this study.
Funding
This work supported by Faculty of Medicine Universitas Diponegoro (Grant number: 233-71/UN7.6.1/PP/2020).
Declaration of Interest
The authors report no conflicts of interest. The authors alone are responsible for the content and writing of the article.
References
Akter, T., Sibbritt, D., & Dawson, A. (2016). Workforce interventions to deliver postnatal care to improve neonatal outcomes in low- and lower-middle-income countries: A narrative synthesis. Asia-Pacific Journal of Public Health, 28(8), 659–681. https://doi.org/10.1177/1010539516656435
Braun, V., & Clarke, V. (2006). Qualitative research in psychology using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Carr, S. (2015). Examining health professional students’ attitudes on interprofessional education. (Publication no. 309) [Doctoral Dissertations, University of Rhode Island]. DigitalCommons@URI. http://digitalcommons.uri.edu/oa_diss/309
Dynes, M., Buffington, S. T., Carpenter, M., Handley, A., Kelley, M., Tadesse, L., Beyene, H. T., & Sibley, L. (2013). Strengthening maternal and newborn health in rural Ethiopia: Early results from frontline health worker community maternal and newborn health training. Midwifery, 29(3), 251–259. https://doi.org/10.1016/j.midw.2012.01.006
Hammick, M., Freeth, D., Koppel, I., Reeves, S., & Barr, H. A. (2007). A best evidence systematic review of interprofessional education. BEME guide no.9. Medical Teacher, 29(8), 735-751. https://doi.org/10.1080/01421590701682576
Herath, C., Zhou, Y., Gan, Y., Nakandawire, N., Gong, Y., & Lu, Z. (2017). A comparative study of interprofessional education in global health care: A systematic review. Medicine, 96(38), 1-7. https://doi.org/10.1097/MD.0000000000007336
Hertweck, M., Hawkins, S., Bednarek, M., Goreczny, A., Schreiber, J., & Sterrett, S. (2012). Attitudes towards interprofessional education: Comparing physician assistant and other health care professions students. The Journal of Physician Assistant Education, 23(2), 8-15.
Hind, M., Norman, I., Cooper, S., Gill, E., Hilton, R., Judd, P., & Jones, S. (2003). Interprofessional perceptions of health care students. Journal of Interprofessional Care, 17(1), 21-34. https://doi.org/10.1080/1356182021000044120
Housley, C. L., Neill, K. K., White, L. S., Tedder, A. T., & Castleberry, A. N. (2018). An evaluation of an interprofessional practice-based learning environment using student reflections. Journal of Interprofessional Care, 32(1), 108–110. http://doi.org/10.1080/13561820.2017.1356808
Lennox, A., & Anderson, E. S. (2012). Delivering quality improvements in patient care: the application of the Leicester Model of interprofessional education. Quality in Primary Care, 20(3), 219–226.
Lestari, E., Scherpbier, A., & Stalmeijer, R. (2020). Stimulating students’ interprofessional teamwork skills through community-based education: A mixed methods evaluation. Journal of Multidisciplinary Healthcare, 13, 1143–1155. http://doi.org/10.2147/JMDH.S267732
McFadyen, A. K., Webster, V. S., & Maclaren, W. M. (2006). The test-retest reliability of a revised version of the Readiness for Interprofessional Learning Scale (RIPLS). Journal of Interprofessional Care, 20(6), 633-639. https://doi.org/10.1080/13561820600991181
Milot, E., Dumont, S., Aubin, M., Bourdeau, G., Azizah, G. M., Picard, L., & St‑Germain, D. (2015). Building an interfaculty interprofessional education curriculum: What can we learn from the Université Laval Experience? Education for Health, 28(1), 58-63. https://doi.org/10.4103/1357-6283.161896
Ngabonzima, A., Kenyon, C., Hategeka, C., Utuza, A. J., Banguti, P. R., Luginaah, I., & F Cechetto, D. (2020). Developing and implementing a novel mentorship model (4+1) for maternal, newborn and child health in Rwanda. BMC Health Services Research, 20(1), Article 924. https://doi.org/10.1186/s12913-020-05789-z
Ngo, A. N., Islam, M. A., Aoyagi, J., Sandor, Z., & Sandor, S. (2021). Prevalence of hypertension in homeless adults: An interprofessional education community-based health fairs cross-sectional study in urban long beach, California. High Blood Pressure and Cardiovascular Prevention, 28(1), 63-68. https://doi.org/ doi: 10.1007/s40292-020-00424-8
Opina-Tan, L. A. (2013). A pilot implementation of interprofessional education in a community‑academy partnership in the Philippines. Education for Health, 26(3), 164-171. https://doi.org/10.4103/1357-6283.125992
Parsell, G., & Bligh, J. (1999). The development of a questionnaire to assess the readiness of healthcare students for interprofessional learning (RIPLS). Medical Education, 33(2), 95-100. https://doi.org/10.1046/j.1365-2923.1999.00298.x
Pollard, K. C., Miers, M. E., Gilchrist, M., & Sayers, A. (2006). A comparison of interprofessional perception and working relationship among health and social care students: The results of a 3-year intervention. Health and Social Care in the Community, 14(6), 541-552. https://doi.org/10.1111/j.1365-2524.2006.00642.x
Randita, A. B. T., Widyandana, W., & Claramita, M. (2019). IPE-COM: A pilot study on interprofessional learning design for medical and midwifery students. Journal of Multidiscipline Health Care, 12, 767–775. http://doi.org/10.2147/JMDH.S202522
Salfi, J., Solomon, P., Allen, D., Mohaupt, J., & Patterson, C. (2012). Overcoming all obstacles: A framework for embedding interprofessional education into a large, multisite bachelor of science nursing program. Journal of Nursing Education, 51(2), 106-110. https://doi.org/10.3928/01484834-20111230-05
Schreiber, J., Goreczny, A., Bednarek, M. L., Hawkins, S. R., Hertweck, M. L., & Sterret, S. E. (2014). The effects of single event interprofessional education (IPE) experience on occupational therapy students’ attitude toward IPE. The Internet Journal of Allied Health Sciences and Practice, 12(1), 1-8. https://doi.org/10.46743/1540-580X/2014.1467
Stewart, V., Betts, H., Chee, P., & Ingamells, A. (2015). Interprofessional learning: Health and allied health students in a community context. Advance in Social Work & Welfare Education, 17(2), 70-85.
Sunguya, B. F., Hinthong, W., Jimba, M., & Yasuoka, J. (2014). Interprofessional education for whom? – Challenges and lessons learned from its implementation in developed countries and their application to developing countries: A systematic review. PLoS ONE, 9(5), e96724. https://doi.org/10.1371/journal.pone.0096724
Tan, K. W., Ong, H. K., & Mok, U. S. (2021). Using simulation and inter-professional education to teach infection prevention during resuscitation. The Asia Pacific Scholar, 6(1), 93-108. https://doi.org/10.29060/TAPS.2021-6-1/OA2229
Thistlethwaite, J. (2012). Interprofessional education: a review of context, learning and the research agenda. Medical Education, 46(1), 58–70. https://doi.org/10.1111/j.1365-2923.2011.04143.x
Torsvik, M., Johnsen, H. C., Lillebo, B., Reinaas, L. O., & Vaag, J. R. (2021). Has “the ceiling” rendered the readiness for interprofessional learning scale (RIPLS) outdated? Journal of Multidisciplinary Healthcare, 14, 523–531. https://doi.org/10.2147/JMDH.S296418
Tyastuti, D., Onishi, H., Ekayanti, F., & Kitamura, K. (2014). Psychometric item analysis and validation of the Indonesian version of the Readiness for Interprofessional Learning Scale (RIPLS). Journal of Interprofessional Care, 28(5), 426-432. https://doi.org/10.3109/13561820.2014.907778
Wagner, J., Liston, B., & Miller, J. (2011). Developing interprofessional communication skills. Teaching and Learning in Nursing, 6(3), 97-101. https://doi.org/10.1016/j.teln.2010.12.003
Wong, P. S., Hasan, S. S., Ooi, J., Lim, L. S. H., & Nadarajah, V. D. (2018). Assessment of attitude for interprofessional team working and knowledge of health professions competencies for final year health professional students. The Asia Pacific Scholar, 3(1), 27-37. https://doi.org/10.29060/TAPS.2018-3-1/OA1064
*Fatikhu Yatuni Asmara
Department of Nursing, Faculty Medicine,
Universitas Diponegoro
Jl. Prof Soedarto, SH, Tembalang,
Semarang, Indonesia
+6281229495962
Email: f.y.asmara@fk.undip.ac.id
Published online: 4 April, TAPS 2023, 8(2), 1-3
https://doi.org/10.29060/TAPS.2023-8-2/EV8N2
Shuh Shing Lee1 & John Norcini2
1Centre for Medical Education, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; 2Foundation for Advancement of International Medical Education and Research, United States of America
It has been almost three decades since Boyer (1990) introduced the concept of the Scholarship of Teaching and Learning (SoTL). In their own disciplines, faculty members are required to stay abreast of emerging knowledge and to contribute to the literature so that they advance their field through well-informed inquiry and disseminated work. Although they also have educational responsibilities, faculty are neither similarly motivated nor are they incentivised to participate in educational scholarship. Consequently, their efforts in this regard are often based on personal belief and opinion rather evidence and scientific inquiry. This problem persists despite a growing body of evidence that adopting sound instructional practices and pursuing scholarly work related to teaching, will increase the quality of the institution’s educational processes. In turn, this will enhance student learning and ultimately lead to better patient care. To achieve this end, teaching and learning must be scrutinised in terms of theory, methods, evidence, and outcomes. And faculty members who engage in teaching need to be rewarded for their participation in educational scholarship just as they are for efforts in their own disciplines.
In supporting educators’ SoTL journey and enhancing the quality of their teaching, this special issue “Celebrating Excellence in Scholarship of Teaching and Learning” aims to demonstrate how educators adopt a scholarly approach and how they collect and present rigorous evidence of their effectiveness. It encompasses much of current health professions education, touching on topics such as interprofessional education, the globalisation of healthcare, the impact of COVID-19, vaccine hesitancy, and digital badges.
Educators from Indonesia shared their strategy for enhancing interprofessional education through community-based education (Kristina et al., 2023). Teams of students developed solutions to family health issues together. The authors found implementation challenges when applying this model, especially in terms of scheduling home visits. However, through this experience the students learned the value of teamwork and the roles of each of the representatives.
As a result of globalisation, there is a significant increase in the number of patients being admitted to hospitals outside of their home countries. The Emergency Department is often the first point of contact for these foreign patients and cultural differences naturally pose challenges. To address this issue and to help patients with different backgrounds obtain high quality care, some hospitals in Japan have initiated cultural awareness training for their doctors. While this is a positive step, doctors in the Emergency Department in Japan still face difficulties in this area. To address these challenges going forward, educators from Japan would like to identify the difficulties still encountered and eventually design scenarios, based on real life cases, for use in simulations (Oikawa et al., 2023).
COVID-19 has changed the way teaching has occurred and it has accelerated the use of technology in all phases of education. This special edition contains two Case Studies related to this issue. The report by Kushare et al. (2023) takes on the use of blended learning that occurred synchronously at different campuses in Malaysia. The report by Lim et al. (2023) focuses on student perspectives on the prohibition of direct patient contact during pandemic. It will be important to follow future developments in these areas as restrictions are lifted.
COVID-19 has not only affected teaching, but it has also had a profound influence on the practice of medicine. Vaccine hesitancy among patients is a growing phenomenon for which not all health care providers are prepared. Physicians may have misconceptions about what drives patient behaviour leading to the less effective provision of information and counselling. To better understand this issue and design a relevant curriculum to create awareness, Jenkins et al. (2023) explored medical students’ reactions to vaccine hesitancy and their reflections on their own biases in patient interactions. The qualitative analysis of students’ reflections offered by the authors is a useful basis for working with students around this issue.
In recent years, digital badges have increasingly become a part of the educational landscape. They constitute an innovative instructional strategy combing the teaching and credentialing of competencies to provide evidence for achievement. However, research in this area is scare. Truskowska et al. (2023) introduced a pilot project regarding the use of digital badges in a Psychiatry module offered as part of a continuous assessment programme. They evaluated the effectiveness of the digital badges based on students’ perspectives of their utility, their level of engagement with the module, and their motivation to study. Students found the badges rewarding but noted that their value was unclear which would eventually lead to a loss of motivation.
Assessment has been a main topic of discussion in SoTL because it shapes how student learn and informs teachers about the effectiveness of their own work. Dayanidhi et al. (2023) present information about a radical curriculum and assessment reform that has been taken place in India. Forensic Medicine and Toxicology, a major competence, is often underrepresented in assessment. The authors established this through an analysis and comparison of the distribution of content tested, domain of learning and construct of the questions derived from undergraduate summative examination question papers on the topic from six universities across India. Also focused on assessment, Lim and Lim (2023) share an innovative assessment method – oral interactive assessment– which they have implemented among the occupational therapy students. Instead of multiple-choice questions or short written answers, each student was assessed with a standardised actor who simulate concerned parents, asking questions about their children’s development. While students are more anxious with this format, an interactive oral assessment has real world relevance.
There are several articles discussing initiatives that were conducted for faculty members in this special issue. For example, Lim et al. (2023) described a coaching programme aimed at providing educators a framework that helps students make discoveries and work towards their goals and training them how to question students. Field et al. (2023) offered a study in training their faculty members to teach and assess students’ clinical thinking skills using a model. Goh and Schlegal (2023) examined the journey of scholarship in health professions education and suggested tangible small steps to start, sustain, and succeed along the SoTL journey.
Felten (2013) in his paper “Principles of Good Practice in SoTL” mentioned that good scholarship should be grounded in context because it takes place in a particular classroom, institution, organisation, and education system where the culture is bounded. Tan et al. (2023) elaborated this aspect in his article using Bronfenbrenner’s Ecological Systems theory (EST). Grant (2023), similarly, highlighted the notion that the practice of teaching is socially bound and highly dependent on the culture, content and context. She further described the relationship between medical educationalists and teachers in the entire SoTL journey.
Good teaching is multidimensional, challenging, and contextual as demonstrated by all the authors in this special issue. However, this is an excellent place to start and it encourages all of us to apply the same thoughts processes to our teaching as we do in our discipline-specific research. Teaching is a process of reflection on our practice and if we follow this dictum, more scholarly teaching will result in higher quality in learning among our students.
Shuh Shing Lee & John Norcini
Guest Editors
The Asia Pacific Scholar (TAPS)
Boyer, E. L. (1990). Scholarship revisited: Priorities of the professionals. Carnegie Foundation for the Advancement of Teaching.
Dayanidhi, V. K., Datta, A., Hegde, S. P., & Tiwari, P. (2023). Evaluating the content validity of the undergraduate summative exam question papers of Forensic Medicine & Toxicology from 6 medical universities in India. The Asia Pacific Scholar, 8(2), 57-65. https://doi.org/10.29060/TAPS.2023-8-2/OA2778
Felten, P. (2013). Principles of Good Practice in SoTL. Teaching & Learning Inquiry: The ISSOTL Journal, 1(1), 121-125. https://doi.org/10.2979/teachlearninqu.1.1.121
Field, S., Croskerry, P., Love, S., & Alexiadis Brown, P. (2023). An online programme in teaching and assessing critical thinking for medical faculty. The Asia Pacific Scholar, 8(2), 66-69. https://doi.org/10.29060/TAPS.2023-8-2/SC2894
Goh, P. S., & Schlegal, E. F. M. (2023). Small, sustainable, steps to success as a scholar in Health Professions Education – Micro (macro and meta) matters. The Asia Pacific Scholar, 8(2), 76-79. https://doi.org/10.29060/TAPS.2023-8-2/SC2861
Grant, J. (2023). The Scholarship of teaching: Who is the truth teller? The Asia Pacific Scholar, 8(2), 83-85. https://doi.org/10.29060/TAPS.2023-8-2/PV2874
Jenkins, M. C., Paul, C. R., Chheda, S., & Hanson, J. L. (2023). Qualitative analysis of reflective writing examines medical student learning about vaccine hesitancy. The Asia Pacific Scholar, 8(2), 36-46. https://doi.org/10.29060/TAPS.2023-8-2/OA2855
Kristina, T. N., Asmara, F. Y., Sudaryanto, S., Nuryanto, N., & Bakri, S. (2023). Increasing the value of Community-Based Education through Interprofessional Education. The Asia Pacific Scholar, 8(2), 4-13. https://doi.org/10.29060/TAPS.2023-8-2/OA2755
Kushare, V., MK., B., Pamidi, N., Selvaratnam, L., Sen, A., & Dominic, N. A. (2023). Vertical integration of anatomy and women’s health: Cross campus blended learning. The Asia Pacific Scholar, 8(2), 89-92. https://doi.org/10.29060/TAPS.2023-8-2/CS2806
Lim, M. J., Wee, J. C. P., Han, D. X. T., & Wong, E. (2023). Perspectives of medical students towards the prohibition of direct patient contact during a pandemic. The Asia Pacific Scholar, 8(2), 93-96. https://doi.org/10.29060/TAPS.2023-8-2/CS2849
Lim, S. M., & Lim, C. Y. (2023). Use of interactive oral assessment to increase workplace readiness of occupational therapy students. The Asia Pacific Scholar, 8(2), 86-88. https://doi.org/10.29060/TAPS.2023-8-2/SC2804
Lim, S. M., Shahdadpuri, R., & Pua, C. Y. (2023). Coaching as an educator: Critical elements in a faculty development program. The Asia Pacific Scholar, 8(2), 70-75. https://doi.org/10.29060/TAPS.2023-8-2/SC2802
Oikawa, S., Ashida, R., & Takeda, S. (2023). Increasing cultural awareness in emergency departments with simulation scenarios created through a survey. The Asia Pacific Scholar, 8(2), 14-35. https://doi.org/10.29060/TAPS.2023-8-2/OA2762
Tan, K., Foo, Y. Y., & Tan, N. C. K. (2023). Refocusing SoTL – Myopia, context lenses and ecological systems theory. The Asia Pacific Scholar, 8(2), 80-82. https://doi.org/10.29060/TAPS.2023-8-2/PV2842
Truskowska, E., Emmett, Y., & Guerandel, A. (2023). Digital badges: An evaluation of their use in a Psychiatry module. The Asia Pacific Scholar, 8(2), 47-56. https://doi.org/10.29060/TAPS.2023-8-2/OA2869
Published online: 3 January, TAPS 2023, 8(1), 1-2
https://doi.org/10.29060/TAPS.2023-8-1/EV8N1
COVID pandemic created worldwide disruptions to all services and had profound impact on training of health professionals, posing serious challenges to maintaining essential healthcare services. During the height of the pandemic, most of the undergraduate learners were prevented from clinical training sites, restricted intra, inter-institutional and overseas learning opportunities and in many institutions, there were termination of onsite learner-educator engagements (Ng et al., 2021; Renaud et al., 2021; Samarasekera et al., 2020). Less face to face, peer and faculty interactions and restricted mobility of learners led to some of them facing poor mental wellbeing and health issues. The learning activities were mostly restricted to online platforms during the pandemic for students following health professional programs. During the latter part of the pandemic, however, there were changes when better preventive measures and immunisation were developed. The students were also allowed to provide limited care services to assist the practitioners who were providing critical services (Lau et al., 2021).
The silver lining, however, was that several new curricular designs, teaching-learning and assessment modalities were developed due to the sheer necessity. The faculty members and students were forced to adapt and adopt these new measures, mostly online systems and processes, to continue the training and provide that much needed support to the healthcare services (Shorey et al., 2022). This became critical when it was apparent that the pandemic would continue for several years. There are some such innovations in teaching-learning highlighting not only the innovation and their impact but also the challenges faced by students and faculty members. Most of these changes to student learning environment were done hurriedly and, unfortunately, without the proper grounding in best evidence practices or taking a systematic approach to incorporate changes to a curriculum. Another reason was the lack of knowledge and support of educators to develop impactful curricula and learning environments leveraging on technology (Popa, 2022).
We are now emerging from the pandemic and many lessons have been learnt from this experience. We now have an opportunity to leapfrog from these experiences. The key to creating an impactful and sustainable post-pandemic learning environment lies with the faculty members. There are several important areas we need to focus on if we want to sustain and further improve the education based on our past experience.
As part of faculty development, it is necessary to engage our faculty members to share best practices and assist them to co-create with their learners teaching-learning activities. For faculty leadership, it is critical to create that safe practice environment for all stakeholders to reflect on and improve what they have developed. Through these collaborative activities, not only the faculty members learn about what works and what to avoid, but also build trust with other stakeholders including the students. Furthermore, it supports them to critically analyse the learning and assessment activities with regard to their relevance in one’s context. Providing a structured and timely faculty support with the necessary resources will augment the building of trust (Connolly et al., 2022).
Another important area we learnt especially during the pandemic and as we currently emerge from the pandemic is the necessity to modify the existing policies and guidelines. These should support systematic and rapid development of learning environments. What worked in the past may not be appropriate now, and even hinder the development of innovative strategies. We need to relook at how we evaluate an educator’s performance and the learning impact from traditional matrixes in place at present in health professional training institutions. Aligned to the performance evaluations, there needs to be supportive schemes to incentivise and reward faculty members who contributed to enhance the learning environment for students and residents.
Medical education is very much context-based and situation-focused. What worked in one setting may not be appropriate in another learning context. The leadership, planners, and educators must be aware of this and carefully design and incorporate innovations and new approaches to learning that have worked in another setting to one’s own. This is especially true when one is incorporating technology-enhanced learning activities such as simulation based or remote distance online learning formats. Finally, the quality improvement and quality assurance processes in health professions education must be aligned to the local context needs. These standards, however, should be benchmarked to internationally accepted best practices, but situated very much on the local needs and promoting impactful changes to student learning environments (Samarasekera & Gwee, 2021).
A quick literature search at present will demonstrate large number of innovations and changes that were incorporated to medical and health professional training curricula over the pandemic period (Ng et al., 2021). It is an opportune time now to focus on developing these changes, based on best evidence practices., The impact of these changes need to be subsequently evaluated to further enhance student learning. At the end of it all, what is most vital is to provide quality care to our patients by competent, caring, and empathetic health professionals.
Dujeepa D. Samarasekera
Centre for Medical Education (CenMED), NUS Yong Loo Lin School of Medicine,
National University Health System, Singapore
Connolly, K. K., Olson, H. L., & Buenconsejo-Lum, L. E. (2022). Medical school faculty development post-pandemic – Opportunities in the digital shift. Hawai’I Journal of Health & Social Welfare, 81(11), 316-318.
Lau, T. C., Chong, Y. S., Loo, B. K. G., Ganapathy, S., Ho, J. M. D., Lee, S. S., Yeo, J., Samarasekera, D. D., & Goh, D. L. M. (2021). Adapting undergraduate paediatric medical education to the challenges of COVID-19 pandemic: Perspective of NUS medicine. Singapore Medical Journal, 62(1 Supp), S39-S42. https://doi.org/10.11622/smedj.2021075
Ng, N. B. H., Chiong, T., Lau, P. Y. W., & Aw, M. A. (2021). Delivering medical education amidst COVID-19: Responding to change during a time of crisis. The Asia Pacific Scholar, 6(3), 111-113. https://doi.org/10.29060/TAPS.2021-6-3/PV2375
Popa, S. (2022). Taking stock: Impacts of the Covid-19 pandemic on curriculum, education, and learning. PROSPECTS, 51, 541-546. https://doi.org/10.1007/s11125-022-09616-7
Renaud, C. J., Chen, Z. X., Yuen, H.-W., Tan, L. L., Pan, T. L. T., & Samarasekera, D. D. (2021). Impact of COVID-19 on health profession education in Singapore: Adoption of innovative strategies and contingencies across the educational continuum. The Asia Pacific Scholar, 6(3), 14-23. https://doi.org/10.29060/TAPS.2021-6-3/RA2346
Samarasekera, D. D., Goh, D. L. M., & Lau, T. C. (2020). Medical school approach to manage the current COVID-19 crisis. Academic Medicine, 95(8), 1126-1127. https://doi.org/10.1097/ACM.0000000000003425
Samarasekera, D. D., & Gwee, M. C. E. (Eds.). (2021). Educate, train and transform: Toolkit on medical and health professions education. World Scientific.
Shorey, S., Pereira, T. L.-B., Teo, W. Z., Ang, E., Lau, T. C., & Samarasekera, D. D. (2022). Navigating nursing curriculum change during COVID-19 pandemic: A systematic review and meta-synthesis. Nurse Education in Practice. 65, Article 103483. https://doi.org/10.1016/j.nepr.2022.103483
Submitted: 28 June 2022
Accepted: 16 August 2022
Published online: 3 January, TAPS 2023, 8(1), 54-56
https://doi.org/10.29060/TAPS.2023-8-1/CS2833
Ying Ying Koh* & Caitlin Alsandria O’Hara*
Yong Loo Lin School of Medicine, National University of Singapore, Singapore
*Both authors contributed equally as first authors.
I. INTRODUCTION
Increasing attention has been given to the role of medical humanities in both clinical care as well as in medical education. Medical humanities is defined as an “interdisciplinary perspective that draws on both creative and intellectual methodological aspects of disciplines such as anthropology, art, bioethics, drama and film, history, literature, music, philosophy, psychology, and sociology” (Hoang et al., 2022).
While 80% of health outcomes are related to the social determinants of health (Magnan, 2017), traditional medical education has largely focused on clinical knowledge and skills. Only in recent years have medical schools recognised the importance of medical humanities (Smydra et al., 2021). The strength of medical humanities is the ability to foster a more humanistic clinical practice and build professional social accountability (Pfeiffer et al., 2016).
In Singapore, the Office of Medical Humanities was set up in the SingHealth Duke-NUS Academic Medical Centre to encourage the growth of the medical humanities in the local medical field (Ong & Anantham, 2019). This highlights the growing interest in medical humanities in Singapore.
This paper aims to highlight an innovative approach for medical humanities education through student-led discussion groups, called ‘MedTalks’, conducted in the Yong Loo Lin School of Medicine, Singapore.
II. A GROUND-UP APPROACH TO THE MEDICAL HUMANITIES
MedTalks was started as a student-led platform for medical students to gain exposure to the medical humanities social issues relating to healthcare. Through Socratic seminar-style discussion among students across all three medical schools in Singapore, MedTalks provides a safe space to learn from each others’ thoughts, and crystallise their own ideas and values. In the long term, MedTalks hopes to empower students to take actionable steps towards addressing the social determinants of health in their future clinical practice.
The initiative was inspired by a yearlong liberal arts non-degree programme in a liberal arts university in the United States which the two student-founders of MedTalks had experienced. This yearlong exposure to the liberal arts–particularly medical anthropology, medical history and political science–also informed the approach and development of the content of sessions. For specific sessions, experts or persons with lived experience were invited to be guest co-facilitators. While the liberal arts exposure provided a foundation, the facilitators themselves have made clear during sessions that they are not subject matter experts, but students who are learning from fellow students through discussion.
III. FORMAT OF SESSIONS
MedTalks runs as a series of discussion sessions, which have three key features. Firstly, they are centred around a theme with accompanying pre-session reading materials for participants. These materials consist of excerpts from book abstracts, journal articles, and multimedia sources (e.g speeches, news sites or videos); these act as a primer on the topic and promote questions or ideas which can be raised in the discussions. Preliminary discussion questions are provided for students to ponder and reflect on prior to the session. Secondly, sessions are facilitated by the student-organisers of the programme. These student-organisers also curate the session themes and pre-reading materials prior to the session. Curation of session themes and materials is done based on themes encountered during clinical rotations, national current affairs, and suggestions from student-participants. Thirdly, participants are not required to speak up during the session; they can choose to simply sit in for the discussion. The fact that sessions are student-led and verbal participation is non-obligatory facilitates a more comfortable environment for students in the discussion and allows them to participate in a way that suits their learning.
MedTalks discussions are varied in scope, with several broad subtypes as follows in Table 1:
|
Introductory discussions These provide a first step towards exploring a discipline in the medical humanities. |
Examples of previous introductory discussions include: – An Introduction to Medical History – An Introduction to Medical Anthropology |
|
Sessions which address key ideas, concepts, and theories These explore a concept in greater detail, sometimes through case studies. |
Examples of previous sessions themed around a key concept include: – Social Determinants of Health – Stigma and Health – Intersectionality and Medicine |
|
Sessions which focus on a specific group of patients These dive deeper into a subgroup of patients or an area of health and wellbeing. Guest participants from the patient group are invited to provide their perspective on their lived experience. |
Examples of previous sessions such as these include: – Disability and Medicine – The History of Psychiatry in Singapore |
|
Sessions about the nature of medical practice These explore cultures, norms, and values within medical practice. |
Examples of previous sessions include: – Empathy in Medicine – The Culture of the Medical Profession |
Table 1. Types and formats of MedTalks discussion sessions
IV. A SAFE SPACE TO ENGAGE: OUTCOMES
Since its inception in May 2020, MedTalks has organised 25 peer-to-peer discussion groups, addressing topics which have not been routinely included in the medical school syllabus. Each discussion session is attended by 5 to 15 medical students. Feedback indicated that MedTalks provides an approachable platform for them to engage with topics that they might be new to and which may seem daunting at first, aided by the student-led nature of the sessions and the lack of pressure to verbally participate. Feedback also included that the takeaways from discussions help to shape the way participants understand the patients they encounter in the hospital–to view them in a more holistic manner beyond their presenting medical complaints, and to consider systemic factors that shape their health and wellbeing. In addition, feedback from the programme also demonstrated that participants’ experience with MedTalks contributed to them starting up new community projects to address barriers to healthcare for marginalised groups.
V. TAKEAWAYS AND THE ROAD AHEAD
MedTalks serves as an example of how the medical humanities can be made accessible to medical students, by medical students themselves. MedTalks’ model can be well-replicated by other interested student bodies, to create a culture of discussion and spark interest in the medical humanities among the medical student community. Potential also exists for discussion sessions to be combined with students from other disciplines, such as allied health, the social sciences, or public health, to bring interdisciplinary and interprofessional perspectives to the table and enrich the discussions shared.
Notes on Contributors
Ms Koh Ying Ying is a founding member of the student initiative, MedTalks. She conceptualised this manuscript, and drafted the first and last sections of the manuscript. She read and approved of the final version of the manuscript.
Ms Caitlin O’Hara is a founding member of the student initiative, MedTalks. She conceptualised this manuscript, and drafted the middle sections of the manuscript. She read and approved of the final version of the manuscript.
Acknowledgement
The authors would like to sincerely thank their mentors for caringly supporting MedTalks as a student-led initiative.
Funding
There are no funding sources to declare for this paper.
Declaration of Interest
The authors have no conflict of interest to declare.
References
Hoang, B. L., Monrouxe, L. V., Chen, K.-S., Chang, S.-C., Chiavaroli, N., Mauludina, Y. S., & Huang, C.-D. (2022). Medical humanities education and its influence on students’ outcomes in Taiwan: A systematic review. Frontiers in Medicine, 9, Article 857488. https://doi.org/10.3389/fmed.2022.857488
Magnan, S. (2017). Social determinants of health 101 for health care: Five plus five. NAM Perspectives, 7(10). https://doi.org/10.31478/201710c
Ong, E. K., & Anantham, D. (2019). The medical humanities: Reconnecting with the soul of medicine. Annals of the Academy of Medicine, Singapore, 48(7), 233–237. Retrieved from https://annals.edu.sg/the-medical-humanities-reconnecting-with-the-soul-of-medicine/
Pfeiffer, S., Chen, Y., & Tsai, D. (2016). Progress integrating medical humanities into medical education: A global overview. Current Opinion in Psychiatry, 29(5), 298–301. https://doi.org/10.1097/YCO.0000000000000265
Smydra, R., May, M., Taranikanti, V., & Mi, M. (2021). Integration of arts and humanities in medical education: A narrative review. Journal of Cancer Education. https://doi.org/10.1007/s13187-021-02058-3
*Ying Ying Koh
10 Medical Dr,
Singapore 117597
Email: kohyingying@u.nus.edu
Submitted: 12 April 2022
Accepted: 19 August 2022
Published online: 3 January, TAPS 2023, 8(1), 57-60
https://doi.org/10.29060/TAPS.2023-8-1/CS2791
Caitlin Hsuen Ng, Siaw May Leong, Arumugam Rajesh Kannan & Deborah Khoo
Department of Anaesthesia, National University Hospital (NUH), Singapore
I. INTRODUCTION
Airway management is critical for any anaesthetist. The Coronavirus Disease 2019 (COVID-19) pandemic has brought such skills to the forefront over the last three years. Yet, the outbreak has also disrupted traditional methods of airway skills training and limited the chances of in-person workshops and conferences due to social distancing requirements and demanding manpower needs. To lower the incidence of airway-related morbidity (Joffe et al., 2019), regular and effective instructional methods are needed to maintain airway providers’ skills.
Our Department of Anaesthesia at the National University Hospital (NUH) of Singapore shares our experience conducting small-group refresher sessions, and how that has changed during a pandemic.
II. ASSESSMENT OF CURRENT LEARNING PROGRAMME AND TRAINING NEEDS
Since 2013, our department has been conducting quarter-yearly intra-departmental mini-workshops for airway training. This was to address the airway component of our patient safety strategy, and the unmet need to maintain and upskill airway management techniques for as many anaesthesia providers as possible, who come with an uneven range of seniority and experience with difficult airways. We were challenged to achieve this goal, yet without overly impacting manpower and daily operations. Each session was led by in-house faculty and was open to anaesthesia providers of every level. On occasion, external faculty were invited if they had specific expertise in certain aspects. The syllabus aligned with Difficult Airway Guidelines (Rosenblatt & Yanez, 2022) and was done in a sequential, repeating manner.
III. INTERVENTION: REFRESHER WORKSHOPS IN THE PANDEMIC
As the COVID pandemic came to Singapore around early 2020, our department training was disrupted in many ways. Nationwide social-distancing measures meant that in-person teachings and elective operations were suspended. The increased patient load from the pandemic also meant more manpower redeployed to the frontlines and Intensive Care Units, with an increased focus on infection control and personal protection. In the event airway intervention was required for a patient, the procedure carried significant risks from the aerosol-generating procedures of intubation and mechanical ventilation to both staff and patients. As a result, clinical exposure for airway providers-in-training was severely hampered.
Hence, alterations were made to our existing regular airway training regime. The didactic segment was smoothly transitioned to the videoconferencing platform, Zoom. This had the added benefit of widening the audience to providers who would otherwise have not been able to physically attend. We continued with the hands-on component of the session, but limited participants in the room at any one time in accordance with the room size, ensuring at least one meter between personnel. Strict personal protection was adhered to, requiring all participants to wear N95 masks and perform hand hygiene before and after each station. Participants also assisted in maintaining the cleanliness of the equipment by using Isopropyl Alcohol 70% wipes to decontaminate all surfaces after use. Given the restricted participant size, a call-back system was used when participants had to be turned away. Attendance was tracked using a manual sign-in system. There were no incidences of transmission of COVID-19 because of these workshops.
We focused on airway management while wearing Personal Protective Equipment to better simulate clinical scenarios, bearing in mind the extra physical and cognitive load that airway providers bear in such circumstances (Foong et al., 2020). Specific skills such as how to safely transfer an intubated patient from one ventilator to another were also practiced and video laryngoscope intubation with a limited field of vision. Figure 1 outlines the suggested format, syllabus, and rationale of our mini-workshops, with the intent that it can be modified as needed and replicated in institution-specific settings.

Figure 1. Suggested template and syllabus of in-house refresher workshops
*added from 2020 onwards
IV. EVALUATION OF INTERVENTION DURING THE PANDEMIC
After almost 10 years, we review our airway training refresher sessions, including its adaptation to the COVID pandemic.
Firstly, the sessions were logistically manageable, using pre-existing equipment and a realistic number of faculty. The intimate number of participants not only complied with safe distancing measures but also encouraged more detailed guidance and supervision of practical skills tailored to the participant’s skill level. Flexibility in attendance allowed for continued participation without significantly affecting manpower during the ongoing pandemic.
Simulation-based mini-workshops allowed for continued honing of skills when authentic clinical scenarios were limited. While simulation is unable to replace the actual experience, it has a positive impact on healthcare systems and their patients during times of a pandemic (Santos et al., 2021). The equipment and techniques covered kept abreast of the latest developments and content was curated to help cope with the pandemic by facilitating familiarity and identification of otherwise unexpected problems in managing a COVID airway, prior to real-life encounters and emergent patient care situations. These measures ensure that such high-risk airways are handled in a safe, accurate, and swift manner, maximising first-pass success, and minimising risks to patients and airway providers in the actual situations (Cook et al., 2020).
The workshops were also able to touch on the softer skills required in airway management. The sessions catered to a mix of staff to build teamwork and coordination in a multidisciplinary airway crisis team. Having a shared plan and proper forms of communication are critical in crisis airway situations, even more so with the additional barrier of PPE. Our in-house training has received positive feedback in increasing staff confidence and preparedness for facing airway crises during times of the pandemic.
V. CONCLUSION
As with any skill, practice is essential. During these times of a public health crisis, we need to be adaptable in our instructional methods of continuing training. We believe that our hands-on refresher sessions have been beneficial in enhancing the accessibility of airway management practice even during a pandemic and suggest a syllabus and method that can be replicated and modified to suit the needs and resources of various settings.
Notes on Contributors
Caitlin Ng took lead in drafting and revising of the manuscript, along with aiding in data collection and analysis.
Leong Siaw May contributed to the conceptualisation of the study and revision of the manuscript and was faculty at some of these workshops.
Arumugam Rajesh Kannan contributed to the conceptualisation of the study and revision of the manuscript and was faculty at some of these workshops.
Deborah Khoo conceptualised of study, led the data collection, was faculty at some of these workshops, and contributed to the revision of the manuscript.
Acknowledgement
Our team would like to thank the department of Anaesthesia, NUH, for the provision of equipment, participation, and facilitation of the faculty in the workshops. We were fortunate to have the equipment and facilities at our disposal to conduct such workshops at our convenience. We understand that this privilege may not be generalisable elsewhere.
Funding
There was no funding received for this project, beyond that of the department’s resources.
Declaration of Interest
The authors report no conflict of interest.
References
Cook, T. M., El-Boghdadly, K., McGuire, B., McNarry, A. F., Patel, A., & Higgs, A. (2020). Consensus guidelines for managing the airway in patients with COVID-19: Guidelines from the Difficult Airway Society, the Association of Anaesthetists the Intensive Care Society, the Faculty of Intensive Care Medicine and the Royal College of Anaesthetists. Anaesthesia, 75(6), 785-799. https://doi.org/10.1111/anae.15054
Foong, T. W., Hui Ng, E. S., Wee Khoo, C. Y., Ashokka, B., Khoo, D., & Agrawal, R. (2020). Rapid training of healthcare staff for protected cardiopulmonary resuscitation in the COVID-19 pandemic. British Journal of Anaesthesia, 125(2), e257-e259. https://doi.org/10.1016/j.bja.2020.04.081
Joffe, A. M., Aziz, M. F., Posner, K. L., Duggan, L. V., Mincer, S. L., & Domino, K. B. (2019). Management of difficult tracheal intubation: A closed claims analysis. Anesthesiology, 131(4), 818-829. https://doi.org/10.1097/aln.0000000000002815
Rosenblatt, W. H., & Yanez, N. D. (2022). A decision tree approach to airway management pathways in the 2022 Difficult Airway Algorithm of the American Society of Anesthesiologists. Anesthesia & Analgesia, 134(5), 910-915. https://doi.org/10.1213/ane.0000000000005930
Santos, T. M., Pedrosa, R. B. S., Carvalho, D. R. S., Franco, M. H., Silva, J. L. G., Franci, D., Jorge, B., Munhoz, D., Calderan, T., Grangeia, T. A. G., & Cecilio-Fernandes, D. (2021). Implementing healthcare professionals’ training during COVID-19: A pre and post-test design for simulation training. Sao Paulo Medical Journal, 139(5), 514-519. https://doi.org/10.1590/1516-3180.2021.0190.R1.27052021
*Caitlin Ng
5 Lower Kent Ridge Road,
Singapore 119074
Email: caitlin_ng97@hotmail.com
Submitted: 27 July 2022
Accepted: 21 September 2022
Published online: 3 January, TAPS 2023, 8(1), 61-63
https://doi.org/10.29060/TAPS.2023-8-1/CS2852
Janaka Eranda1, Hewapathirana Roshan2 & Karunathilake Indika3
1Ministry of Health, Sri Lanka; 2Department of Anatomy, Genetics and Biomedical Informatics, Faculty of Medicine, University of Colombo, Sri Lanka; 3Department of Medical Education, Faculty of Medicine, University of Colombo, Sri Lanka
I. INTRODUCTION
Anatomy is considered as one of the key components of undergraduate medical education. Hence, it is important to have a sound knowledge in anatomy to proceed into clinical medicine. Didactic lectures, textbooks, prosected specimens, and cadaveric dissection are the most frequently used anatomy teaching methods. However, with the emergence of COVID-19 pandemic, conventional teaching and learning were challenged. Technology integration for medical education has been increased during COVID-19 in many countries. With the integration of new technologies to the anatomy teaching, the traditional ‘directed self-learning’ started to move towards ‘self-directed learning’. This transformation however, was not without various challenges, especially in low-resource settings such as Sri Lanka (Karunathilake et al., 2020). Augmented reality (AR), Virtual reality (VR), and principles of gamification play an important role in motivation and engagement in medical teaching and learning by enhancing interactivity (Moro et al., 2021). Such technologies also found to have positive impact on students’ spatial understanding and 3D comprehension of anatomical structures.
The objectives of this case study were to identify the context-specific factors in designing AR/VR-based anatomy instructional materials and to assess the student motivation and engagement to use gamification in their studies. The instructional systems design model ADDIE (Molenda, 2003), which is an acronym for Analyze, Design, Develop, Implement, and Evaluate, was used to develop the instructional materials in this study since it found to ensure the appropriateness of the materials used in an optimal manner to bring the maximum educational outcome.
II. METHODS
During the study, mixed-method tradition was followed in a Sri Lankan medical faculty from September 2020 to February 2021. Ethics approval was obtained from the Ethics Review Committee of the Postgraduate Institute of Medicine, University of Colombo where the study was exempted from the review process. Purposive sampling was the method adhered recruiting 92 undergraduate medical students and 20 lecturers with the informed consent of the participants. The methodology was phased out according to the ADDIE model.
A. Analysis
A qualitative study was conducted using semi-structured interviews with the lecturers. The interviews were informed by the six dimensions of the Hexagonal E-Learning Assessment Model – HELAM (Ozkan & Koseler, 2009) which consists of students’ attitudes, teachers’ attitudes, technology-enhanced learning, content quality, service quality and supportive factors in designing effective E-learning materials. This phase revealed lecturers’ suggestions to develop AR/VR contents in terms of graphical user interfaces, modes of navigation, interactivity, and strategies in incorporating modes of gamification into learning materials.
B. Design
The results of the analysis phase were used to develop a blueprint of the instructional materials integrating the modes of gamification. These were instrumentalised to enhance the motivation and engagement in developed learning materials.
C. Development
An AR/VR application was developed using Unity game engine using 3D anatomy models to project 3D anatomy models over 2D reference images to be used with smart phones and generic VR boxes.
D. Evaluation
This phase consisted of a quantitative study offered to undergraduate students. The self-administered questionnaire with 40 questions of the type 5-point Likert-scale was used to assess participants’ self-reported perceptions of motivation and engagement in self-directed learning. The questionnaire assessed the gamification approach, teaching materials, user interfaces, practicability, physical discomfort, student attitudes on PC-based games, AR/VR apps. The developed apps were used by the students prior to complete the survey.
III. RESULTS
A. Qualitative Study
Lecturers expressed their interest in AR/VR technology with gamification and suggested to link the new AR/VR contents to the existing Learning Management System as the students already have a good engagement with it. They highlighted different modes of gamification such as interactive quizzes, animated interactive 3D anatomy models, teleport targets for VR navigation and video clips to enhance interactivity. Furthermore, they emphasized the importance of the quality of the content, reliability of the information technology services and course administration related factors to improve the overall quality of the learning experience and the sustainability of the new approach.
B. Quantitative Study
The results were organized along the dimensions, gamification, teaching materials, user interfaces, practicability, students’ attitudes toward the technology-enhanced learning and AR/VR apps. The gamification dimension indicated the overall acceptance for the AR/VR techniques and tools and adapting the technology-enhanced learning in formal medical curricula. The highest mean value (4.20 out of the scale ranging from 1 to 5) was observed for the use of the augmented reality app indicating that medical students participated were satisfied with the offered interactivity in the AR/VR apps. The average satisfaction score for gamification, practicability, physical discomfort, teaching materials, user interfaces, student attitudes on the technology-enhanced game and AR/VR app were above satisfactory level (score ≥ 4). The student’s satisfaction on the physical discomfort showed the lowest average score compared to the rest of the dimensions. Further to this, the students had lesser variation in the satisfaction score about the dimension attitudes on the technology-enhanced learning (SD 0.41) compared to the other dimensions. The questionnaire included six questions to measure the level of motivation and engagement. On average, 88% of the students have expressed their willingness to engage with the AR/VR learning style and confirmed that the technology-enhanced learning is a beneficial learning style.
IV. DISCUSSION
The study was conducted to identify the measures to improve motivation and engagement in learning anatomy when integrating technology-enhanced interactive learning contents into the undergraduate medical curriculum. The importance of having a systematic approach is necessary when designing instructional content to obtain a better outcome. The use of principles of gamification improved motivation and engagement which is in line with previous studies (Moro et al., 2022). Sustainability of the technology-enhanced learning was a key concern among the lecturers.
V. CONCLUSION
This research attempted to identify the student motivation and engagement towards the gamified anatomy learning with AR/VR technology. The study provided the insight into context-specific factors in designing interactive learning contents and methods. The ability to deliver an immersive experience in AR/VR methods helps the student to study anatomy in self-directed learning even in situations, such as COVID-19 pandemic and mandatory social distancing, which demands strict remote teaching.
Notes on Contributors
Dr G.K.M.E. Janaka, MBBS, MSc, MD was involved in reviewing the literature, formulating the methodological framework, designed the gamified AR and VR learning tools and and writing the original draft.
Dr Roshan Hewapathirana, MBBS, MSc, PhD, MIEE was involved in the study by developing the methodological framework, data curation, formal analysis, and editing the original draft.
Professor Karunathailke Indika, MBBS(Col), CTHE (Col), DMedEd (Dundee), MMedEd (Dundee), FHEA (UK), FCGP( SL), FRCP (Edin.), FCME (SL) was involved in the study by conceptualizing the idea, developing the methodological framework, creviewing the manuscript and supervising the overall study.
Acknowledgement
The authors would like to acknowledge the Head of the Department and the lecturers of the Department of Anatomy, Genetics and Biomedical Informatics, Faculty of Medicine, University of Colombo who supported giving valuable comments and all the students who had volunteered in participating in the study.
Funding
There are no funding sources to declare.
Declaration of Interest
The authors declare that they have no competing interests.
References
Karunathilake, I. M., Dissanayake, V. H. W., Yasawardena, S., Abegunawardena, A., Raviraj, S., Wijesinghe, P. S., Anthony, A. A., Wijesinghe, R. A. N. K., Bowatte, S., Wickramaratne, N., Pathirana, K. D., Pilapitiya, S., Edirisinghe, S., Hettiarachchi, D., Kohombange, C., & Olipeliyawa, A. (2020). The new normal of medical education – Challenges and opportunities. South-East Asian Journal of Medical Education, 14(1), 2. https://doi.org/10.4038/seajme.v14i1.241
Molenda, M. (2003). In Search of the Elusive ADDIE Model. Performance Improvement, 42(5), 34–37.
Moro, C., Birt, J., Stromberga, Z., Phelps, C., Clark, J., Glasziou, P., & Scott, A. M. (2021). Virtual and augmented reality enhancements to medical and science student physiology and anatomy test performance: A systematic review and meta analysis. Anatomical Sciences Education, 14(3), 368–376. https://doi.org/10.1002/ase.2049
Moro, C., Phelps, C., & Birt, J. (2022). Improving serious games by crowdsourcing feedback from the STEAM online gaming community. The Internet and Higher Education, 55, Article 100874. https://doi.org/10.1016/j.iheduc.2022.100874
Ozkan, S., & Koseler, R. (2009). Multi-dimensional students’ evaluation of e-learning systems in the higher education context: An empirical investigation. Computers & Education, 53(4), 1285–1296. https://doi.org/10.1016/j.compedu.2009.06.011
*Janaka Eranda
Ministry of Health,
Sri Lanka
+94714747309
Email: erandajanaka1979@gmail.com
Submitted: 24 May 2022
Accepted: 16 August 2022
Published online: 3 January, TAPS 2023, 8(1), 51-53
https://doi.org/10.29060/TAPS.2023-8-1/CS2818
Teresa Diana B. Bongala
Department of Obstetrics and Gynaecology, Faculty of the College of Medicine, University of the East Ramon Magsaysay Memorial Medical Centre, Philippines
I. INTRODUCTION
The world will never be the same after the COVID-19 pandemic. Education has had to evolve. Evaluation of cognitive skills is still achieved by written examinations administered through learning management systems. However, an integral part of evaluation, the Objective Structured Clinical Examination (OSCE), which assesses the students’ ability to obtain, communicate information, perform physical examination, diagnose, and solve problems, could not be given due to COVID-19 restrictions.
Simulation during teaching and assessments like the OSCE have been done worldwide, (Nguyen et al., 2015) and have been utilised in our university for more than twenty years. Because of lockdowns due to Covid-19, the OSCE was given online in medical schools worldwide, however the number of students were limited (Boyle et al., 2020; Lara et al., 2020). In the Philippines, by December 2020, immunisation against Covid-19 had not started, and travel was still restrictive, hence face-to-face classes were still limited. (Department of Education, 2020). Hence, the Department of Obstetrics and Gynaecology of our university planned and conducted the first large-scale summative virtual OSCE (VOSCE) for Level III medical students.
II. METHODS
The summative VOSCE was conducted using a Zoom licensed Education account, with features called “Breakout Rooms” and “Screen Share” and the Canvas learning management system. There were 17 faculty, 10 residents, 15 post-graduate interns, 10 Level IV and 440 Level III students who participated. The Level III students had synchronous and asynchronous lectures for four-and-a-half months in Obstetrics, and nine weeks of small group discussions (SGD).
The table of specifications was based on the learning outcomes in Obstetrics and skills taught during SGDs. Six sets of examinations with four stations, were prepared. The first two stations were given in Canvas, while the last two “performance” stations, namely history taking, and Physical Examination (PE) were given over Zoom. The evaluation in OSCE was modified to fit tasks for VOSCE. It underwent an MPL setting by three members of the faculty using the Angoff method. (Livingston & Zieky, 1982)
All participants underwent orientation. The students were informed of the materials they needed: a computer, for Canvas and for zoom in stations 3 and 4; a mobile device, for proctoring, communication and to demonstrate performance /PE in Station 4; and other materials needed for Station 4. The faculty were instructed to Screen Share tasks via Zoom in the “performance” stations and oriented on student evaluation and result submission.
Three days before the VOSCE, a simulation involving clinical clerks, post-graduate interns and residents was conducted. Clarity of video, audio and internet speed were checked. Timing and transfer of examinees between breakout rooms was also rehearsed. The tasks for Stations 3 and 4, and evaluation forms, were sent to the faculty the 12 hours before the VOSCE.
Thirty minutes before the VOSCE, the students underwent identity verification, their gadgets and positions checked. Concurrently, the post-graduate interns, who acted as patients, were given the script.
The examinees, in stations 1 and 2, givenclinical vignette and images of speculum examination, had to diagnose and write a prescription. After Canvas stations, in another breakout room, the students were informed of materials needed for Station 4. In Station 3, they elicited the history from a simulated patient, and in Station 4, they performed PE with annotation.
Communication with students was through Telegram and Zoom, while Viber was used between faculty and residents.
III. RESULTS
Four hundred and forty students took part in the VOSCE. Post-VOSCE survey with 397 respondents showed that 382 (96.2%) students took it in the Philippines, and 15 (0.38%) students were out of the country.
Forty-three (10.8%) had internet speed <10mbps. Thirty (9.0%) had connection problems/unable to view images in stations 1 and/or 2. Thirty students were given another examination, three hours post-VOSCE. Table 1 shows the location and the internet connection of the students, their perception of the VOSCE and the problems they encountered during the examination.
|
Questions |
Number (%) |
|
Location during VOSCE |
|
|
Philippines (except Manila) MetroManila Outside of Philippines |
230 (57.93 %) 152 (38.28%) 15 (3.87%) |
|
Internet speed (mbps) |
|
|
< 10 10-100 > 100 |
43 (10.8%) 328 (82.61%) 26 (6.5%) |
|
Orientation |
|
|
Adequate Inadequate Absent |
336 (84.63%) 47 (11.84%) 14 (3.52%) |
|
SGDs helpful |
|
|
Strongly agree/Agree Neutral Disagree/strongly disagree |
319 (80.3%) 58 (14.6 %) 20 (5.03%) |
|
Canvas rubrics helpful |
|
|
Strongly agree/ Agree Neutral Disagree /Strongly disagree |
335 (84.38%) 49 (12.3 %) 13 (3.3%) |
|
VOSCE problems |
|
|
None Temporary disconnection Disconnection Stations 1/or2 Internet lag Poor audio |
265 (66.75%) 63 (15.86%) 30 (9.00%) 24 (6.04%) 15 (3.77%) |
|
Tension prevented me from performing well |
|
|
Strongly agree/Agree Neutral Disagree/Strongly disagree |
229 (57.68%) 101 (25.4 %) 67 (16.87%) |
|
Internet/gadget prevented me from performing well |
|
|
Strongly agree/Agree Neutral Disagree/Strongly disagree |
129 (32.49%) 94 (23.7 %) 174 (43.83%) |
Table 1. Post-VOSCE Survey n= 397
IV. DISCUSSION
Participants orientation and the simulation were important in ensuring the success of this VOSCE. The students perceived that SGDs 319 (80.3 %), Canvas rubrics 335 (84.4%), and orientation 336 (84.63%), helped in their preparation. However, the students viewed that tension 129 (32.49%) and internet and gadget issues 229 (57.68 %) prevented them from performing well.
Passing rates were comparable, with OSCE 75.68 % and VOSCE 78.9 %. Moreover, the mean score of the VOSCE 81, was only slightly lower than OSCE mean, 82.07.
With ease of restrictions the following year, we continued using VOSCE because we obtained similar results to OSCE, it was less costly and easier to manage. Post-pandemic it will remain an important tool for formative and summative assessments. Among its advantages, there are examiners/faculty available for the VOSCE because it is online. Furthermore, it can be modified to administer some stations online, while conducting the PE stations onsite.
V. CONCLUSION
We have demonstrated that the VOSCE may be given successfully and will continue to play an important role in assessment post-pandemic. It is more convenient and economical to administer. Its main disadvantages include the possibility of internet disruption and gadget malfunction. However, with planning, innovation, orientation, and communication, it may be administered without major problems. It is reassuring that whatever restrictions we may face in the future, the VOSCE, will ensure we can continue to produce competent doctors, who will be part of the solution to the healthcare problems of the world.
Notes on Contributors
The author did the literature review, conceptualised and oversaw the implementation of the VOSCE, created the post exam survey, retrieved previous grades pre-pandemic, analysed the data and wrote the manuscript.
Acknowledgement
The author would like to acknowledge the administration and the faculty of the Department of Obstetrics and Gynaecology of the University of the East Ramon Magsaysay Memorial Medical Centre, for their trust and support in the planning and conduction of the VOSCE. Special thanks to the residents who helped to orient the participants, monitored, and helped in running Canvas and Zoom. The author would also like to extend her gratitude to the clinical clerks and the postgraduate interns, who have given their time during the technical dry run and for serving as standardised patients during the conduct of the VOSCE.
Funding
The author did not receive any funding for this study.
Declaration of Interest
The author does not have any conflict of interest.
References
Boyle, J. G., Colquhoun, I., Noonan, Z., McDowall, S., Walters, M. R., & Leach, J. P. (2020). Viva la VOSCE? BMC Medical Education, 20(1). Article 514. https://doi.org/10.1186/s12909-020-02444-3
Department of Education. (2020, December). Official statement on the pilot implementation of limited face-to-face classes. Retrieved July 20, 2021, from https://www.deped.gov.ph/2020/12/15/official-statement-on-the-pilot-implementation-of-limited-face-to-face-classes/
Lara, S., Foster, C. W., Hawks, M., & Montgomery, M. (2020). Remote assessment of clinical skills during COVID-19: A virtual, high-stakes, summative pediatric objective structured clinical examination. Academic Pediatrics, 20(6), 760-761. https://doi.org/10.1016/j.acap.2020.05.029
Livingston, S. A., & Zieky, M. J. (1982). Passing scores: A manual for setting standards of performance on educational and occupational tests. Educational Testing Service.
Nguyen, L., Tardioli, K., Roberts, M., & Watterson, J. (2015). Development and incorporation of hybrid simulation OSCE into in-training examinations to assess multiple CanMEDS competencies in urologic trainees. Canadian Urological Association Journal, 9(1-2), 32. https://doi.org/10.5489/cuaj.2366
*Teresa Diana B. Bongala
64 Aurora Boulevard,
Quezon City, Metro Manila,
Philippines
+639175776420
Email: tbbongala@uerm.edu.ph
Submitted: 22 February 2022
Accepted: 3 August 2022
Published online: 3 January, TAPS 2023, 8(1), 47-50
https://doi.org/10.29060/TAPS.2023-8-1/SC2764
Kye Mon Min Swe1 & Amit Bhardwaj2
1Department of Population Medicine, University Tunku Abdul Rahman, Malaysia; 2Department of Orthopaedics, Sengkang General Hospital, Singapore
Abstract
Introduction: During the era of COVID-19 pandemic, online learning has become more prevalent as it was the most available option for higher education training which has been a challenging experience for the students and the lecturers especially in the medical and health sciences training. The study was conducted to determine the perceptions of clinical year medical students on online learning environments during the COVID-19 pandemic.
Methods: A cross sectional study was conducted to clinical year medical students at University Tunku Abdul Rahman. The validated Online Learning Environment Survey (OLES) was used as a tool to conduct the study.
Results: Total 84 clinical year students participated in the study. Among four domains of OLES questionnaire, the domain; “Support of online learning” had the highest mean perception scores, 4.15 (0.55), followed by “Usability of online learning tools” 3.89 (0.82), and “Quality of Learning; 3.80 (0.68) and the domain “Enjoyment” was the lowest mean perception scores 3.48 (1.08). Most of the students (52.4%) rated the overall satisfaction of online teaching experiences “Very good” while (13.1) % rated “Excellent”.
Conclusion: In conclusion, the perceptions of clinical year medical students on online learning environments during the COVID-19 pandemic were satisfactory although there were challenging online learning experiences during the pandemic. It was recommended to include qualitative method in future studies to provide more useful in-depth information regarding online learning environment.
Keywords: Online Learning Environment, Perceptions, Medical Students, Malaysia, COVID-19
I. INTRODUCTION
Online learning is defined as learning via web-based technology and students interact with their peers and educators through web-based communication tools (Bonk & Reynolds, 1997). The usability of the web-based learning system is important as are its applications such as interactive video, forums, chat rooms, email, and document sharing systems (Klein et al., 2006).
Online learning is regarded nowadays as a new way of interaction in the educational process and online learning facilities offer various opportunities to get new knowledge and develop students’ skills through engagement and interaction in new learning environments. (Samoylenko et al., 2022)
Due to the novel coronavirus pandemic, all the higher education training has converted to online teaching and assessments including medical programs. To fulfil the student physical learning time requirement, the academic year of MBBS clinical year programmes (Year 3 to Year 5) has been divided into Phase 1; purely online teaching as medical students were not allowed to be posted to hospitals followed by Phase 2; face to face physical clinical training at the hospital. Phase 1 teaching for clinical years include, online task-based learning, online lectures and online case-based discussion, online clinical skill, and procedures. This research study was conducted to evaluate the online learning environment of clinical year students and to find out differences in students’ perceptions between the academic years.
II. METHODS
A cross sectional study was conducted to (total=135) Year 3 to Year 5 clinical year medical students. 43 students were in Year 3, 49 students were in Year 4 and 43 students were in Year 5 at University Tunku Abdul Rahman (UTAR), Selangor, Malaysia. All the clinical year students were invited to participate in the study by sending electronic invitations emails, informed consent was taken. Data was collected via google form and the information was anonymised.
A validated Online Learning Environment Survey (OLES) (Pearson & Trinidad, 2005) was used to evaluate the online learning environment of medical students of UTAR during Phase 1 of purely online teaching. The questionnaire consists of two sessions. Section (I) general demographic information, Section (II) contains 50 items of OLES questionnaires developed by Pearson and Trinidad (2005). The validity of the tool was recorded as Cronbach’s Alpha Coefficient value of 0.79 to 0.90. The OLES consists of nine scales: Computer Usage (CU); Teacher Support (TS); Student Interaction & Collaboration (SIC); Personal Relevance (PR); Authentic Learning (AL); Student Autonomy (SA); Equity (EQ); Enjoyment (EN); and A-synchronicity (AS) which can further classified into four domains: (1) Support for learning; (2) Quality of learning; (3) Usability of online learning tools; and (4) Enjoyment. Responses were recorded against a five-point scale with the following representations: 1- Never; 2- Seldom; 3- Sometimes; 4- Often; and 5- Almost Always. (Pearson & Trinidad, 2005)
Data were analysed by using SPSS (Statistical Package for Social Science) for Windows, version 26.0. The categorical variables were described by frequency and percentage. Student t-test and Analysis of variance (Anova) test was used to compare means between the groups of different academic years. Ethical approval was acquired from the Scientific Ethical Review Committee of the UTAR.
III. RESULTS
A total of 84 clinical year medical students participated from Year 3 to Year 5. There were 27 out of 43 Year 3 students (62.79%), 26 out of 49 Year 4 students (53.06%), 31 out of 43 Year 5 students (72.09%) who completed the questionnaire. Approximately 82 (97.6%) students were aged between 21 to 25 years and (63.1%) were female students.
The online learning environment survey (OLES) tool consists of four domains to evaluate student online learning environments such as “Support of Online learning”, “Usability of online learning tools”, “Quality of Learning” and “Enjoyment”. Among four domains of OLES tool, the domain; “Support of online learning” had the highest mean perception scores 4.15 (0.55), followed by “Usability of online learning tools” 3.89 (0.82), and “Quality of Learning; 3.80 (0.68) and the domain “Enjoyment” was the lowest mean perception scores 3.48 (1.08).
|
Domains of perceptions of online learning environment |
Subscales of perceptions of online learning environment |
Mean (SD) |
Mean (SD) |
|
Support for learning |
Computer Usage |
4.24 (0.64) |
4.15 (0.55) |
|
Teacher Support |
4.09 (0.78) |
||
|
Student Interaction and Collaboration |
4.02 (0.78) |
||
|
Equity |
4.25 (0.82) |
||
|
Quality of learning |
Personal Relevance |
3.60 (0.87) |
3.80 (0.68) |
|
Authentic Learning |
3.66 (0.82) |
||
|
Student Autonomy |
4.16 (0.76) |
||
|
Usability of online learning tools |
A-synchronicity |
3.89 (0.81) |
3.89 (0.82) |
|
Enjoyment |
Enjoyment |
3.48 (1.08) |
3.48 (1.08) |
Table 1: The mean perception scores of domains and subscales of online learning environment
Regarding the relation between academic year and student perception on different domains of the online environment, Year 5 students 3.89 (1.01) enjoyed the online learning as compared to Year 3 3.25(0.95) and Year 4 students 3.22 (1.18) respectively and the difference was statistically significant (P<0.027). Year 4 students perceived more positive on domains support of learning (P=0.658) and quality of learning (P=.396) and Year 5 students perceived online learning tools were useful (P=0.681).
The students were asked to rate their online learning experience via 5 points scale, poor to excellent and (52.4%) of the students found online learning experiences very good followed by (29.4%) good and (13.4%) rated excellent. The data for this research can be accessed at http://doi.org/10.6084/m9.figshare.19322297
IV. DISCUSSION
During COVID-19 pandemic era, medical clinical teaching via online was a challenging experience for both clinical lecturers and clinical year students and this study was to determine the perceptions of clinical year medical students on online learning environments during the COVID-19 pandemic.
A. Evaluating Online Learning Environment
In the literature, there were quite several tools which have been developed to specifically evaluate online learning environments such as Constructivist On-Line Learning Environment Survey (COLLES), Web-Based Learning Environment Inventory (WEBLEI), Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI), and Online Learning Environment Survey (OLES). The OLES instruments have been used to evaluate the university’s online learning environment and found to be a useful tool to evaluate online learning environments as the questionnaires were applicable to our local setting of online teaching. The OLES tool consists of four domains to evaluate student online learning environments such as Support of Online learning, Usability of online learning tools, Quality of Learning and Enjoyment. (Chew, 2015) The scores on scales which received specific attention for online educators to monitor the online learning environment provided for students.
1) Support of online learning: This domain includes four sub scales and it is the most important part for the students to be able to cope with the online learning environment. Regarding support for computer usage, the findings indicate the students received good support from the university regarding online learning such as the providing internet package for students, laptops, online learning tools and platforms such as Microsoft team. The support from lecturers and peers were also important in regarding clinical case discussion and group works. But in some cases, the students need to go and use internet at their relative’s house. On the “Lecturer Support Scale” and “Equity scale”, that the students got support and equivalent chances to contribute in class discussion. (Chew, 2015)
2) Usability of online learning tools: This domain includes asynchronicity subscale. Asynchronicity allows students to learn on their own schedule, within a certain timeframe. In this study, there were high mean scores for the “Asynchronicity” scale which indicates that the students found it easier to communicate online. But the result was contrary to a study by Chew (2015), found out that the students found it challenging to communicate online depends on the availability of internet and usage of social media.
3) Quality of learning: This domain includes three subscales: Personal Relevance, Student Autonomy, and Authenticity learning. The findings indicate that the students were able to manage and play significant roles in their learning in the online learning climates.
4) Enjoyment: The Enjoyment scale was used to evaluate the extent of enjoyment of learning in an online learning environment. Among all four domains, the enjoyment was the least mean perception score which indicated that although the students received support from university and lecturers, they enjoyed less with the online classes as the classes were entirely online. The result was similar to a study by Chew (2015), stated that the students had limited enjoyment in online learning environments due to lack of motivation and technical problems.
B. Limitations of the study
The study was conducted in a private medical university and quantitative approach. A mixed methods approach with larger sample was recommended for future investigations. Validation of the survey recommends carrying out for local setting.
C. Implication of the study
The present study evaluates the online learning environment experienced by clinical year medical students which found to be useful by giving them different learning opportunities and this can be used to implicate future clinical teaching as hybrid mode to create an effective and safe learning environment. The information from this study about the students’ perceptions on online learning, provided significant implications in the field such as implementation of hybrid learning, telemedicine in medical curriculum.
V. CONCLUSION
In conclusion, the perceptions of clinical year medical students on online learning environments during the COVID-19 pandemic were satisfactory although there were challenging online learning experience during the pandemic. It was recommended to include qualitative method in future studies to provide more useful in-depth information regarding online learning environment.
Notes on Contributors
Dr Kye is the corresponding author for this paper. She designed the study, analysed the data, prepared the manuscript working together with the co-author.
Dr Amit Bhardwaj made substantial contributions to the design, editing and preparation of the final manuscript.
Ethical Approval
The research study was approved by Universiti Tunku Abdul Rahman Scientific and Ethical Review committee on 20th July 2020 (Approval number: U/SERC/92/2020).
Data Availability
The data that support the findings of the study are openly available at http://doi.org/10.6084/m9.figshare.19322297
Acknowledgement
We would like to acknowledge the clinical medical students of UTAR (Academic Year 2020/2021) for voluntary participation in this study.
Funding
There was no funding for this research study.
Declaration of Interest
The authors declare that there are no conflicts of interest, including financial, consultant, institutional and other relationships.
References
Bonk, C. J., & Reynolds, T. H. (1997). Learner-centred web instruction for higher order thinking, teamwork, and apprenticeship. In B. H. Khan (Ed.), Web-based instruction (pp.167-178). Englewood Cliffs.
Chew, R. (2015). Perceptions of online learning in an Australian University: Malaysian students’ perspective – Support for Learning. International Journal of Information and Education Technology, 5(8), 587-592. https://doi.org/10.7763/ijiet.2015.v5.573
Klein, H. J., Noe, R. A., & Wang, C. W. (2006). Motivation to learn and course outcomes: The impact of delivery mode, learning goal orientation, and perceived barriers and enablers. Personnel Psychology, 59(3), 665–702. http://doi.org/10.1111/j.1744-6570.2006.00050.x
Samoylenko, N., Zharko, L., & Glotova, A. (2022). Designing online learning environment: ICT tools and teaching strategies. Athens Journal of Education, 9(1), 49-62. https://www.athensjournals.gr/education/2022-9-1-4-Samoylenko.pdf
Pearson, J., & Trinidad, S. (2005). OLES: An instrument for refining the design of e-learning environments. Journal of Computer Assisted Learning, 21(6), 396- 404. https://doi.org/10.1111/j.1365-2729.2005.00146.x
*Kye Mon Min Swe
Jalan Sungai Long, Bandar Sungai Long,
43000 Kajang, Selangor
+601115133799
Email: drkyemonfms@gmail.com
Submitted: 29 May 2022
Accepted: 16 August 2022
Published online: 3 January, TAPS 2023, 8(1), 43-46
https://doi.org/10.29060/TAPS.2023-8-1/SC2807
Kirsty Foster
Academy for Medical Education, Medical School, University of Queensland, Brisbane, Australia
Abstract
Introduction: A series of workshops was held early in our MD curriculum redesign with two aims: gaining stakeholder input to curriculum direction and design; engaging colleagues in the curriculum development process.
Methods: Workshops format included rationale for change and small-group discussions on three questions: (1) Future challenges in healthcare? (2) our current strengths? (3) Future graduate attributes? Small-group discussions were audio-recorded, transcribed and fieldnotes kept and thematically analysed. We conducted a literature review looking at best practice and exemplar medical programs globally.
Results: Forty-seven workshops were held across 17 sites with more than 1000 people participating and 100 written submissions received. Analysis showed alignment between data from workshops, written submissions and the literature review.
The commitment of our medical community to the education of future doctors and to healthcare was universally evident.
Six roles of a well-rounded doctor emerged from the data: (1) Safe and effective clinicians – clinically capable, person-centered with sound clinical judgement; (2) Critical thinkers, scientists and scholars with a thorough understanding of the social and scientific basis of medicine, to support clinical decision making; (3) Kind and compassionate professionals – sensitive, responsive, communicate clearly and act with integrity; (4) Partners and team players who collaborate effectively and show leadership in clinical care, education and research; (5) Dynamic learners and educators – adaptable and committed to lifelong learning; and (6) Advocates for health improvement – able to positively and responsibly impact the health of individuals, communities and populations
Conclusion: Deliberate stakeholder engagement implemented from the start of a major medical curriculum renewal is helpful in facilitating change management.
Keywords: Medical Education, Medical Curriculum, Stakeholder Engagement, Collaboration
I. INTRODUCTION
The quality of the medical education we provide to future doctors is directly related to the quality of care they will provide to their future patients (Torralba & Katz, 2020). It is the responsibility of those involved and of medical schools to promote the highest standards of medical education and medical student learning. At the University of Queensland, a major reimagining of the MD Program is underway to ensure that our already strong medical program remains informed by best practice in both medicine and in education. This is crucial to enabling our medical graduates to be optimally equipped for their internship, pre-vocational and specialist training. It is our responsibility to enable our graduates to be ready for the future medical needs of the people and communities they serve.
Medical programs are complex and involve many people. As well as University academic and professional staff, medical students are taught, supervised and supported by a wide variety of doctors and other health professionals during the four years of our postgraduate degree. At our university we have approximately 4,500 affiliates who may have a role in teaching, supervising or otherwise influencing one or more medical students at some point during their four-year MD program. Many of these are clinical teachers or supervisors who work for the health services with which UQ has a student placement agreement in place. Cognisant that major curricular review is challenging we implemented a deliberate strategy of engagement with as many of our stakeholders as possible from the start of the MD Design project in 2019. In the first stage we planned a series of engagement workshops with key stakeholders and this is the basis of the study.
The purpose of our study was twofold:
Firstly, to gain input from a wide range of stakeholders early in the process to futureproof our curriculum – that is, to inform the vision on what our graduates need to be able to know, do, and be, to succeed in internship and beyond.
Secondly, to involve our key stakeholders in the curriculum design process as a component of change management.
II. METHODS
A series of stakeholder workshops was held. The format of each workshop was to start with a brief outline of the drivers and rationale for curricular change, followed by small-group interactive discussions focusing on three questions:
- What are the major future challenges in relation to healthcare?
- What are our current strengths as a Medical Program, as a university and as a health community?
- What are the important attributes for our future graduates to achieve to best prepare them for their careers?
Ethics approval for the study was granted by the University of Queensland Human Research Ethics Committee (Approval number 2019001725). At the start of each workshop attendees were provided with information about the study and given the opportunity to withdraw. Their participation in the workshop was regarded as consent. All small-group discussions were overseen by KF, audio-recorded and transcribed. KF and the administrative team kept field notes capturing any elements additional to the spoken word such as the general atmosphere of the workshop. KF and JH analysed the transcripts thematically identifying key elements in each focus area. In parallel a literature review was conducted looking at best practice medical education and exemplar medical programs across the globe were explored.
III. RESULTS
Over a period 15 months between July 2019 and January 2021 47 workshops were held across 17 sites with more than 1100 people participating. More than 100 written submissions were received and 5814 people and organisations contacted. Analysis demonstrated general agreement that major change was needed and there was good alignment between feedback received from stakeholder workshops, written submissions and the key findings from the current state analysis as outlined above. There were some stakeholders who felt that they needed to see more substantial evidence that the current curriculum needed refreshing. This group felt reluctant to embark on further change in view of modifications already made in recent years. They were also concerned that ‘change fatigue’ may be a challenge especially among our health service colleagues who contribute to the program.
A key finding was that the passion and commitment of our medical community to the education of future medical doctors and to make a positive contribution to healthcare was universally evident.
The resulting vision for our new MD program is:
To nurture and educate future medical graduates who are clinically capable, team players, kind and compassionate, serve responsibly and are dedicated to the continual improvement of the health of people and communities in Queensland, Australia and across the globe.
To enhance the capability of our graduates to meet the needs of their future patients a set of six roles of the all-round high-quality doctor was developed from the data. These roles map to the four domains that the Australian Medical Council require for primary medical degrees (Australian Medical Council (AMC), 2012), and have been adopted as the vertical themes of the new MD program. They are:
- Critical thinkers, scientists and scholars who have a thorough knowledge and understanding of the social and scientific basis of medicine, and able to apply evidence and research to inform and support clinical decision making.
- Dynamic learners and educators who continue to adapt, are curious, agile, motivated, self-directed, with the ability to honestly and humbly appraise their own learning needs, and have a commitment to lifelong learning.
- Advocates for health improvement who stand with people and are able to positively and responsibly impact the health of individuals, communities and populations. Are able to apply an understanding of health inequalities to strive for health equity, and incorporates prevention and advocacy into clinical practice in all settings.
- Partners and team players who collaborate effectively and show leadership when appropriate in the provision of clinical care and health-related education and research.
- Kind and compassionate professionals who are sensitive, responsive, communicate clearly and act with integrity. Compassion and professionalism are linked not only to improved patient outcomes but to better practitioner outcomes including job satisfaction and to better institutional outcomes.
- Safe and effective clinicians who are clinically capable, person-centred and demonstrate sound clinical judgement – and who can see that they cannot be safe and effective unless they are also capable in all other roles.
The new MD program is structured as five fully integrated courses, three year-long and two semester long courses in final year, with assessment focused on growth and development of knowledge skills and attitudes through active engagement in learning. Assessment for learning as well as of learning is fundamental in enabling all students to reach their full potential. The project has progressed through development of staged learning outcomes for each year of the program and now into detailed and appropriately sequenced learning activities.

Figure 1. The six roles of a well-rounded doctor
IV. DISCUSSION
Communication throughout a period of major change is challenging especially where there are many diverse stakeholders across a large and complex organisation like a medical school (Velthuis et al., 2018). Our strategy was a deliberate one to retain connection and involvement during a lengthy process. Our initial engagement work reported here gave us a good start by actively involving as many people as possible from the beginning of the project. As the project has progressed stakeholders have remained engaged and have been particularly keen on seeking the detail needed to assist in implementation of the new curriculum. This has, on occasion, been challenging when tension between some specialist discipline areas protecting their ‘patch’ and the needs of medical students at primary medical degree level emerge. We also found that education is not regarded as a specialist field by some of our experienced clinical teachers. A lack of understanding about the iterative process of outcomes-based curriculum development contributed to colleagues seeking answers about what is to be taught being frustrated at what they saw as a laborious process of careful scaffolding and integration. This contesting of curriculum is recognised within institutions where it can inhibit development of more effective curricula which promote learning and are more than simply identification of content to be taught (Prideaux, 2003). By engaging with stakeholders from the earliest stage of the curriculum development process we feel that we have minimised this effect.
V. CONCLUSION
Our experience demonstrates that a deliberate stakeholder engagement strategy implemented from the start of a major curriculum renewal is helpful in maintaining key stakeholder involvement. We found that facilitating a collective discussion about the direction and underpinning values of an innovative medical curriculum was a helpful strategy although some stakeholders felt that, since their wishes had not been adopted, they had not been involved. Despite this, we found that, in most cases, stakeholder involvement from the start led to ongoing collaboration in the change management of implementing a new medical program.
We must ensure that our graduates are optimally prepared to begin their careers as medical practitioners over the next 30 to 40 years, and are ready to meet the needs of the people of Queensland, Australia and globally. We are confident that our early engagement on MD Design will help to achieve that goal.
Notes on Contributors
KF conceptualised, led the workshops where data were collected, contributed to data analysis and wrote the manuscript.
Ethical Approval
Ethics Approval for the study was obtained from the University of Queensland Human Research Ethics Committee, Application number 2019001725 granted June 2019. Potential participants were provided with study information prior to the workshops and their active participation in the ensuing workshop was taken to indicate consent.
Data Availability
Data is not currently stored in the UQ Data repository because of its nature, as transcripts of meeting discussions where the partipants may be identified would breach the conditions of ethics approval.
Acknowledgement
The curriculum design project described in this study is an endeavour involving a large number of people. The author would especially like to thank Professor Stuart Carney, Dean of the Medical School for his support in many of the engagement sessions, Dr Jane Hallos for her assistance with data collection, analysis and literature review, Ms Alexandra Longworth for assistance in data collection and all workshop participants for their input.
Funding
The study was funded as part of the MD Design project led by the Faculty of Medicine at the University of Queensland. There was no specific grant funding but the Mayne Bequest supported medical education research expenses.
Declaration of Interest
The author has no conflict of interest to declare.
References
Australian Medical Council (AMC). (2012). Standards for assessment and accreditation of primary medical programs by the Australian Medical Council 2012. Australian Medical Council Ltd.
Prideaux, D. (2003). ABC of teaching and learning in medicine: Curriculum design. BMJ, 326(7381), 268-270. https://doi.org/10.1136/bmj.326.7383.268
Torralba, K. M. D., & Katz, J. D. (2020). Quality of medical care begins with quality of medical education. Clinical Rheumatology, 39, 617-618. https://doi.org/10.1007/s10067-019-04902-w
Velthuis, F., Varpio, L., Helmich, E., Dekker, H., & Jaarsma, A. D. C. (2018). Navigating the complexities of undergraduate medical curriculum change: change leaders’ perspectives. Academic Medicine, 93(10), 1503-1510. https://doi.org/10.1097/ACM.0000000000002165
*Kirsty Foster OAM
Academy for Medical Education, Medical School,
Level 6, Oral Health Centre,
288 Herston Road
Herston QLD 4006 Australia
+61 7 3346 4676
Email: Kirsty.foster@uq.edu.au
Announcements
- Best Reviewer Awards 2024
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2024.
Refer here for the list of recipients. - Most Accessed Article 2024
The Most Accessed Article of 2024 goes to Persons with Disabilities (PWD) as patient educators: Effects on medical student attitudes.
Congratulations, Dr Vivien Lee and co-authors! - Best Article Award 2024
The Best Article Award of 2024 goes to Achieving Competency for Year 1 Doctors in Singapore: Comparing Night Float or Traditional Call.
Congratulations, Dr Tan Mae Yue and co-authors! - Fourth Thematic Issue: Call for Submissions
The Asia Pacific Scholar is now calling for submissions for its Fourth Thematic Publication on “Developing a Holistic Healthcare Practitioner for a Sustainable Future”!
The Guest Editors for this Thematic Issue are A/Prof Marcus Henning and Adj A/Prof Mabel Yap. For more information on paper submissions, check out here! - Best Reviewer Awards 2023
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2023.
Refer here for the list of recipients. - Most Accessed Article 2023
The Most Accessed Article of 2023 goes to Small, sustainable, steps to success as a scholar in Health Professions Education – Micro (macro and meta) matters.
Congratulations, A/Prof Goh Poh-Sun & Dr Elisabeth Schlegel! - Best Article Award 2023
The Best Article Award of 2023 goes to Increasing the value of Community-Based Education through Interprofessional Education.
Congratulations, Dr Tri Nur Kristina and co-authors! - Volume 9 Number 1 of TAPS is out now! Click on the Current Issue to view our digital edition.

- Best Reviewer Awards 2022
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2022.
Refer here for the list of recipients. - Most Accessed Article 2022
The Most Accessed Article of 2022 goes to An urgent need to teach complexity science to health science students.
Congratulations, Dr Bhuvan KC and Dr Ravi Shankar. - Best Article Award 2022
The Best Article Award of 2022 goes to From clinician to educator: A scoping review of professional identity and the influence of impostor phenomenon.
Congratulations, Ms Freeman and co-authors. - Volume 8 Number 3 of TAPS is out now! Click on the Current Issue to view our digital edition.

- Best Reviewer Awards 2021
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2021.
Refer here for the list of recipients. - Most Accessed Article 2021
The Most Accessed Article of 2021 goes to Professional identity formation-oriented mentoring technique as a method to improve self-regulated learning: A mixed-method study.
Congratulations, Assoc/Prof Matsuyama and co-authors. - Best Reviewer Awards 2020
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2020.
Refer here for the list of recipients. - Most Accessed Article 2020
The Most Accessed Article of 2020 goes to Inter-related issues that impact motivation in biomedical sciences graduate education. Congratulations, Dr Chen Zhi Xiong and co-authors.









