{"id":72299,"date":"2023-11-27T13:53:11","date_gmt":"2023-11-27T05:53:11","guid":{"rendered":"https:\/\/medicine.nus.edu.sg\/taps\/?post_type=issues&#038;p=72299"},"modified":"2024-04-02T08:13:10","modified_gmt":"2024-04-02T00:13:10","slug":"entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs","status":"publish","type":"issues","link":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/","title":{"rendered":"Entrustable Professional Activities implementation in undergraduate allied health therapy programs"},"content":{"rendered":"<p>Submitted: 24 January 2023<br \/>\r\nAccepted: 2 August 2023<br \/>\r\nPublished online: 2 January, TAPS 2024, 9(1), 42-48<br \/>\r\n<a href=\"https:\/\/doi.org\/10.29060\/TAPS.2024-9-1\/SC2997\">https:\/\/doi.org\/10.29060\/TAPS.2024-9-1\/SC2997<\/a><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Rahizan Zainuldin<sup>1<\/sup> &amp; Heidi Siew Khoon Tan<sup>1,2<\/sup><\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: justify;\"><i><sup><span lang=\"EN-GB\">1<\/span><\/sup><\/i><i><span lang=\"EN-GB\">Health and Social Sciences Cluster, Singapore Institute of Technology, Singapore; <sup>2<\/sup>Pre-Professional Education Office, Tan Tock Seng Hospital, Singapore<\/span><\/i><\/p>\r\n<p style=\"text-align: center;\"><b><span lang=\"EN-GB\">Abstract<\/span><\/b><\/p>\r\n<p style=\"text-align: justify;\"><b><span lang=\"EN-GB\">Introduction<\/span><\/b><span lang=\"EN-GB\">: Singapore Institute of Technology\u2019s undergraduate (UG) occupational therapy (OT) and physiotherapy (PT) programs are one of the first implementors of Entrustable Professional Activities (EPAs) in the respective allied health professions training. The aim of the paper is to report the outcomes of the first year of EPAs implementation in clinical practice education (CPE) and share next steps refining implementation.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><b><span lang=\"EN-GB\">Methods<\/span><\/b><span lang=\"EN-GB\">: <\/span><span lang=\"EN-GB\">A quality improvement (QI) study using the Plan-Do-Check-Act (PDCA) cycle was conducted. UG OT Year 2 and Year 3 students, UG PT Year 3 students and their clinical educators (CEs) who experienced the use of EPAs for the first time were surveyed at the end of the clinical block.<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: justify;\"><b><span lang=\"EN-GB\">Results<\/span><\/b><span lang=\"EN-GB\">: There was <\/span><span lang=\"EN-GB\">generally high agreement (&gt;70% agreed or strongly agreed) among all groups in using EPAs to better understand the learning objectives of CPE and practice expectations as future entry-level practitioners at conditional-registration. <span>More than 70% of OT respondents but less than 50% PT respondents found the EPA assessment forms easy to use.<\/span> Less than 60% of both program CEs did not include colleagues for EPA assessments. 55% of both OT and PT CEs found the EPA training and resources adequate. Overall, PT respondents showed lower agreement than OT respondents in five survey items.<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: justify;\"><b><span lang=\"EN-GB\">Conclusion<\/span><\/b><span lang=\"EN-GB\">:<\/span><span lang=\"EN-GB\"> <\/span><span lang=\"EN-GB\">The first implementation cycle of EPA in the undergraduate OT and PT CPE had mixed acceptability to the EPA assessment tools. Three strategic changes were made for the second implementation cycle., i.e., redesign of EPA-based assessment forms, training focus and \u2018just-in-time\u2019 training with streamlined resources.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><b><span lang=\"EN-GB\">Keywords<\/span><\/b><b><span lang=\"EN-GB\">:<\/span><\/b><span lang=\"EN-GB\">\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 <\/span><i><span lang=\"EN-GB\">Clinical Training, Entrustable Professional Activities, Occupational Therapy, Physiotherapy, Undergraduate, Workplace-based Assessment<\/span><\/i><b><span lang=\"EN-GB\"><\/span><\/b><\/p>\r\n<p style=\"text-align: center;\"><span lang=\"EN-GB\"><\/span><strong><span lang=\"EN-GB\">I. INTRODUCTION<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">In 2021, the occupational therapy (OT) and physiotherapy (PT) undergraduate programs at Singapore Institute of Technology (SIT) added a novel assessment, Entrustable Professional Activities (EPAs), to the extant competency-based assessment tools in clinical practice education (CPE). EPAs are units of professional activities entrusted to a learner determined by five levels of supervision, once the learner has demonstrated the required competence (ten Cate &amp; Taylor, 2020). OT EPAs and PT EPAs (Zainuldin &amp; Tan, 2021) were developed and introduced to SIT CPE as part of the Ministry of Health\u2019s review of healthcare professions\u2019 training standards. EPA-based assessments are relevant in CPE where students perform professional activities at workplace, supervised by onsite clinical educators (CEs). Previous CPEs assessed only OT and PT student competencies using the validated Student Practice Evaluation Form-Revised Edition (SPEF-R) (Turpin et al., 2011) and the Clinical Competency and Reasoning Assessment (CCRA), respectively. Conceptually, the pairing of EPAs with SPEF-R or CCRA potentially offer CEs an opportunity to empower students through graduated levels of entrustment supported by appropriate proficiency levels. Operationally, EPA assessment does not add new activities. OT and PT CEs can utilise routine observations of students\u2019 tasks, case discussions and case-notes documentation as sources to inform entrustment levels in EPAs. <\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">No EPA implementation in any OT and PT curricula has been documented. At SIT, EPA implementation in CPE needs evaluation. Recognising that implementing process changes requires an iterative approach, SIT embarked on a quality improvement study using the Plan-Do-Check-Act (PDCA) cycle. This paper reports the results of operationalising EPAs for the first time in OT and PT CPE, including the use of EPA-based assessment forms. The Methods section describes the <i>Plan <\/i>and<i> Do<\/i>, followed by the Results section reporting outcomes of the <i>Check<\/i> and the<i> <\/i>Discussion section highlighting the <i>Act<\/i> to improve implementation.<\/span><\/p>\r\n<p style=\"text-align: center;\"><span lang=\"EN-GB\"><\/span><strong><span lang=\"EN-GB\">II. METHODS<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><em><span lang=\"EN-GB\">A. <\/span><span lang=\"EN-GB\">CPE Structure<\/span><\/em><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">OT CPE consists of four blocks of seven weeks each and interspersed between academic modules in Years 2, 3 and 4. PT CPE consists of five consequent blocks (four core and one elective) of six weeks each, begins only after all academic modules are completed in Year 3 and continues to Year 4. OT and PT students complete different clinical settings for each CPE block.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><i><span lang=\"EN-GB\">B. Participants and Study Design<\/span><\/i><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">OT Year 2 and Year 3 students, PT Year 3 students and their CEs who experienced EPA use for the first time were surveyed at the end of a clinical block. An online EPA survey is incorporated with routine post placement feedback for both students and CEs, therefore no consent was required. The QI study was exempt from ethics review (SIT Institutional Review Board, No. 2022122). Survey results were extracted from February to December 2021.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><i><span lang=\"EN-GB\">C. PDCA Cycle: Plan-Do<\/span><\/i><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">OT and PT have five core EPAs each. EPA-based assessment activities are short practice observations, entrustment-based discussions and case-notes evaluations. These activities serve as sources of information (SOIs), or workplace-based assessments (WBAs) in OT CPE, to inform entrustment decision-making. OT CE assesses EPAs by documenting in a single patient case form with all three WBAs per EPA. PT CE assesses EPAs for every patient case anchored by three different SOI forms with written justifications. OT and PT CEs and students were trained on nuts and bolts of EPAs and on using WBA\/SOI forms in CE training workshops and student pre-CPE briefing, respectively.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Each OT EPA requires a total of six patient cases entrusted to students at Level 3 entrustment (indirect supervision) across four CPE blocks. Each PT EPA requires six cases at Level 3 entrustment at each core clinical block, which totals 24 cases by end of the program. Appendix 1 and 2 provides visualisation of EPA implementation across multiple CPE blocks.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">The EPA survey has ten items. The first eight items are scored on a 4-point Likert-scale (strongly disagree-strongly agree). The final two questions seek qualitative feedback on benefits and challenges and suggestions for improvements. Unless indicated, items are phrased in the same manner in both student and CE surveys.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><i><span lang=\"EN-GB\">D. Data Collection and Analysis<\/span><\/i><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Data were counted as proportions of respondents who agreed (pooled response from \u2018agree\u2019 and \u2018strongly agree\u2019) and proportions disagreed (pooled from \u2018disagree\u2019 and \u2018strongly disagree\u2019). The authors grouped the qualitative narrative into benefits and challenges.<\/span><\/p>\r\n<p style=\"text-align: center;\"><span lang=\"EN-GB\"><\/span><strong><span lang=\"EN-GB\">III. RESULTS<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><i><span lang=\"EN-GB\">A. PDCA Cycle: Check<\/span><\/i><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">There were 99.0% response rate from OT Year 2 students (105\/106), 97.7% from Year 3 OT students (85\/87), 93.2% from PT Year 3 students (137\/147), 98.5% from OT CEs (199\/202) and 92.5% from PT CEs (247\/267). Proportion of respondents who agreed with each item statement is shown in Table 1. Data on item scores for each student and CE are available at online repository, <\/span><span lang=\"EN-US\"><a href=\"http:\/\/doi.org\/10.6084\/m9.figshare.21941288\"><span lang=\"EN-GB\">http:\/\/doi.org\/10.6084\/m9.figshare.21941288<\/span><\/a><\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<div align=\"center\">\r\n<table border=\"0\" cellspacing=\"0\" cellpadding=\"0\" class=\" aligncenter\" style=\"width: 100%;\">\r\n<tbody>\r\n<tr>\r\n<td width=\"206\" rowspan=\"2\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">Survey Items<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">OT Year 3 students <\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">OT Year 2 students <\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">PT Year 3 students <\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">OT CEs <\/span><\/p>\r\n<p align=\"center\"><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">PT CEs <\/span><\/p>\r\n<p align=\"center\"><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">(n = 85)<\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">(n = 105)<\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">(n = 137)<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">(n = 199)<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">(n = 247)<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q1 &#8211; Using EPAs in CPE helps me better understand and meet future conditional-registration requirements.<\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">90.6<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">98.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">75.2<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">89.4<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">71.7<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q2 &#8211; The EPA documents help me to better understand the learning objectives in CPE.<\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">84.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">98.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">72.3<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">75.9<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">71.7<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q3 &#8211; The WBA\/SOI forms are easy to use.<\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">76.5<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">85.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">38.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">73.4<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">47.8<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q4 \u2013 <i><u>CE<\/u>: <\/i>The WBA\/SOI forms are adequate for me to determine students\u2019 competence and entrustment level. \/ <\/span><\/p>\r\n<p><i><u><span lang=\"EN-GB\">Student<\/span><\/u><\/i><i><span lang=\"EN-GB\">: <\/span><\/i><span lang=\"EN-GB\">The WBAs\/SOIs help me to better gauge my progress and level of competence.<\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">91.8<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">97.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">70.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">72.9<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">64.6<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q5 &#8211; I understand the connection between OT EPAs and SPEF-R2 competencies or PT EPAs and CCRA.\u00a0\u00a0 <\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">84.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">97.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">72.3<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">69.8<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">83.0<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q6 \u2013 <i><u>CE<\/u>: <\/i>I use the EPA documents explicitly with students during clinical teaching and assessment. \/ <i><u>Student<\/u>: <\/i>I use the EPA documents to guide my learning goals during CPE.\u00a0\u00a0\u00a0 <i><\/i><\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">62.4<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">92.4<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">51.1<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">87.9<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">59.1<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q7 \u2013 <i><u>CE:<\/u><\/i> I involve other colleagues in doing WBAs\/SOIs to calibrate students\u2019 entrustment level. \/ <i><u>Student:<\/u><\/i> Besides my CE, I also received feedback from other OTs or other PTs who were involved in my WBAs\/SOIs.<\/span><\/p>\r\n<p><span lang=\"EN-GB\">\u00a0<\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">44.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">66.7<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">54.0<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">58.8<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">45.3<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"206\">\r\n<p><span lang=\"EN-GB\">Q8 &#8211; I feel the current briefing\/training\/resources are adequate for me to incorporate the use of EPAs in CPE.\u00a0\u00a0\u00a0 <\/span><\/p>\r\n<\/td>\r\n<td width=\"75\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">70.6<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"79\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">89.5<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"77\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">56.2<\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">55.3<\/span><\/p>\r\n<\/td>\r\n<td width=\"73\" valign=\"top\">\r\n<p align=\"center\"><span lang=\"EN-GB\">55.9<\/span><\/p>\r\n<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<p align=\"center\" style=\"text-align: center;\"><span lang=\"EN-GB\">Table 1. Proportion of OT and PT students and CEs who agree with the EPA survey items<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">PT CEs and students were almost unanimous that SOI forms were difficult to use (Q3). Common to OT and PT CEs, many did not involve colleagues in EPAs (Q7) and felt that training to understand EPAs was inadequate (Q8).<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Qualitatively, both disciplines benefitted from the use of WBA\/SOI forms to scaffold learning through structured feedback and action plans when addressing identified competency gaps. Feedback from OT and PT students below closely exemplified the appreciation:<i> <\/i><\/span><\/p>\r\n<p style=\"text-align: justify;\"><i><span lang=\"EN-GB\">\u201cEPAs allow me to track my progress over the weeks and transfer my reflections into action when given the opportunity to receive objective and qualitative feedback from the EPA form.\u201d <\/span><\/i><\/p>\r\n<p align=\"right\" style=\"text-align: right;\"><span lang=\"EN-GB\">OT Student#45<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">\u201c<i>The discussions with the CE on what to do if the situation was different made me realise the importance of planning even for the worst-case scenario\u2026enabled me to identify the gaps in knowledge and skills that had to be worked on.<\/i>\u201d <\/span><\/p>\r\n<p align=\"right\" style=\"text-align: right;\"><span lang=\"EN-GB\">PT Student#67<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">However, PT groups cited complicated forms design and copious paperwork from numerous SOIs time-consuming and stressful. Ambivalence on its practicality was best summed by PT CE#31, \u201c<i>As a first-time user of the SOIs, I found it quite difficult to navigate the forms, took me some tries to understand how I can determine the students&#8217; competence and entrustment level. As there were many forms, it was quite confusing, and hence stressful and time-consuming. Otherwise, they are useful tools.<\/i>\u201d<\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">The most common challenge among OT CEs was assessing certain EPAs, such as planning care transition, in some settings. \u201c<i>Some EPAs are harder to do in some settings, for example, in the hands therapy setting; it is harder to do the handover\/discharge EPA as there are less of these patients.\u201d (<\/i>OT CE#32<i>)<\/i>. Calling for more support, one CE suggested<i> \u201cSIT go through a round of training on the different EPAs and give relevant case examples to help us better understand them.\u201d<\/i> (OT CE#4).<\/span><\/p>\r\n<p style=\"text-align: center;\"><span lang=\"EN-GB\"><\/span><strong><span lang=\"EN-GB\">IV. DISCUSSION<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Response rates were excellent. The convergence of high agreement rates with narrative feedback on using EPAs and WBA\/SOIs for teaching\/learning, understanding the CPE learning objectives and meeting practice expectations as future entry-level practitioners suggest early indication that EPAs may facilitate SIT OT and PT students transit to new practitioners. The positive experience in this regard resonated with other EPA survey on final-year dietetics students and their clinical supervisors in Australia (Bramley et al., 2021). Practical challenges with the SOI forms, resulting in onerous and time-consuming evidence collection; low levels in involving colleagues in EPA assessments; and inadequate EPA training\/resources for CEs were identified as key areas for change in both disciplines.<\/span><\/p>\r\n<p style=\"text-align: justify;\"><em><span lang=\"EN-GB\">A. <\/span><span lang=\"EN-GB\">PDCA Cycle: Act<\/span><\/em><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">First, to reduce assessment burden, WBA and SOI forms were redesigned and harmonised in preparation towards a standardised EPA online assessment system currently developed in-house. Multiple WBA\/SOI forms were combined into a single-page checklist form with a small open-ended section. A checklist was similarly suggested for nursing EPAs assessment, citing convenience as a reason (Lau et al., 2020). On the single-page form, CEs tick entrustment levels for each WBA\/SOI associated to each EPA with all EPAs on the same page. The only narrative section is where CEs describe key justifications supporting their entrustment decisions, followed by students\u2019 reflections. Second, to bridge assessment expectations among clinicians and increase propensity to share EPA assessments with colleagues, EPA training was refined to emphasise balance of supervision control with autonomy and clearer definitions between entrustment levels 2 (direct supervision) and 3 (indirect supervision) through case examples. Third, \u2018just-in-time\u2019 refresher training was added to activate volition in assessing EPAs. Toolkits containing briefing videos and streamlined resources in short bites, such as 3-minute videos, powtoons, form samplers and frequently-asked-questions, were released for OT and PT CEs closer to placement block. PT CEs also received a refresher at early weeks of every placement block. <\/span><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: center;\"><span lang=\"EN-GB\"><\/span><strong><span lang=\"EN-GB\">V. CONCLUSION<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">The PDCA cycle is used to inform and make iterative adaptations to each cycle of EPA implementation. The <i>Plan-Do<\/i> stage completed the first implementation cycle of EPA in the undergraduate OT and PT CPE in 2021. The <i>Check<\/i> stage revealed mixed experiences to EPA use. The lowest agreement was the ease of using SOI forms among PT students and CEs. While EPAs were accepted as teaching and learning tools, CEs did not involve colleagues in EPA assessments. Training on EPA assessment for CEs was inadequate. Consequently, the <i>Act<\/i> stage yielded changes in form design, training focus and streamlined resources for the next implementation cycle. <\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Notes on Contributors<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Rahizan Zainuldin (RZ) led the design of the quality improvement and implementation of EPAs, submitted the study to SIT IRB, analysed and interpreted both quantitative and qualitative data for the PT CPE, prepared the manuscript, wrote the initial draft and finalised for submission. <\/span><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Heidi Siew Khoon Tan (HSKT) led the design of the EPA survey, analysed and interpreted both quantitative and qualitative data for the OT CPE, provided a critical review of the manuscript, and concurred on the final version.<\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Ethical Approval<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">The QI study was exempt from ethics review (SIT Institutional Review Board, No. 2022122).<\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Data Availability<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Data on item scores for each student and CE are available at online repository, publicly accessed at <\/span><span lang=\"EN-US\"><a href=\"http:\/\/doi.org\/%2010.6084\/m9.figshare.21941288\"><span lang=\"EN-GB\">http:\/\/doi.org\/ 10.6084\/m9.figshare.21941288<\/span><\/a><\/span><span><span lang=\"EN-GB\">. <\/span><\/span><span lang=\"EN-GB\">While the data is available for readers\u2019 perusal and no permission from the authors is needed, please write an email of intention to use the data for any purposes to the corresponding author.<\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Acknowledgement<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">We would like to acknowledge the OT and PT CPE committee members who have contributed in the planning and implementation of the EPA. We would also like to thank Ms Annie Wang Haiyan, Manager, Academic Programmes Administration, SIT, for uploading the survey on and extracting the survey results from the online assessment portal of our Clinical Practice Education portal.\u00a0 <\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Funding<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">No funding source is provided.<\/span><\/p>\r\n<p align=\"center\" style=\"text-align: center;\"><strong><span lang=\"EN-GB\">Declaration of Interest<\/span><\/strong><\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\">Rahizan Zainuldin and Heidi Siew Khoon Tan disclose there is no conflict of interest of any form.<\/span><\/p>\r\n<p style=\"text-align: center;\"><strong><span lang=\"EN-GB\">References<\/span><\/strong><\/p>\r\n<p style=\"text-align: left;\"><span lang=\"EN-GB\">Bramley, A. L., Thomas, C. J., McKenna, L., &amp; Itsiopoulos, C. (2021). E-portfolios and entrustable professional activities to support competency-based education in dietetics. <i>Nursing and Health Sciences, 23<\/i>(1), 148-156. <\/span><a href=\"https:\/\/doi.org\/10.1111\/nhs.12774\"><span lang=\"EN-GB\">https:\/\/doi.org\/10.1111\/nhs.12774<\/span><\/a><\/p>\r\n<p style=\"text-align: left;\"><span lang=\"EN-GB\">Lau, S. T., Ang, E., Samarasekera, D. D., &amp; Shorey, S. (2020). Evaluation of an undergraduate nursing entrustable professional activities framework: An exploratory qualitative research. <i>Nurse Education Today, 87, <\/i>Article 104343. <\/span><a href=\"https:\/\/doi.org\/10.1016\/j.nedt.2020.104343\"><span lang=\"EN-GB\">https:\/\/doi.org\/10.1016\/j.nedt.2020.104343<\/span><\/a><span lang=\"EN-GB\"><\/span><\/p>\r\n<p style=\"text-align: left;\"><span lang=\"EN-GB\">ten Cate, O., &amp; Taylor, D. R. (2020). The recommended description of an entrustable professional activity: AMEE Guide No. 140. <i>Medical Teacher 43<\/i>(10), 1106-1114. <\/span><a href=\"https:\/\/doi.org\/10.1080\/0142159X.2020.1838465\"><span lang=\"EN-GB\">https:\/\/doi.org\/10.1080\/0142159X.2020.1838465<\/span><\/a><\/p>\r\n<p style=\"text-align: left;\"><span lang=\"EN-GB\">Turpin, M., Fitzgerald, C., &amp; Rodger, S. (2011). Development of the Student Practice Evaluation Form Revised Edition Package. <i>Australian Occupational Therapy Journal<\/i>, <i>58<\/i>(2), 67-73. <\/span><a href=\"https:\/\/doi.org\/10.1111\/j.1440-1630.2010.00890.x\"><span lang=\"EN-GB\">https:\/\/doi.org\/10.1111\/j.1440-1630.2010.00890.x<\/span><\/a><\/p>\r\n<p style=\"text-align: left;\"><span lang=\"EN-GB\">Zainuldin, R., &amp; Tan, H. Y. (2021). Development of entrustable professional activities for a physiotherapy undergraduate programme in Singapore. <i>Physiotherapy<\/i>, <i>112<\/i>, 64-71. <\/span><a href=\"https:\/\/doi.org\/10.1016\/j.physio.2021.03.017\"><span lang=\"EN-GB\">https:\/\/doi.org\/10.1016\/j.physio.2021.03.017<\/span><\/a><\/p>\r\n<p style=\"text-align: left;\">*Rahizan Zainuldin<br \/>\r\n10 Dover Road, <br \/>\r\nSingapore 138683<br \/>\r\n+6596522418<br \/>\r\nEmail: Rahizan.Zainuldin@singaporetech.edu.sg<\/p>\r\n<p style=\"text-align: justify;\"><span lang=\"EN-GB\"><\/span><\/p>\r\n<\/div>","protected":false},"featured_media":0,"parent":0,"menu_order":6,"template":"","issues_category":[17],"archive_category":[],"issue_type":[25],"volume_category":[61881],"class_list":["post-72299","issues","type-issues","status-publish","hentry","issues_category-short-communications","issue_type-past-issue","volume_category-volume-9-number-1-january-2024"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar\" \/>\n<meta property=\"og:description\" content=\"Submitted: 24 January 2023 Accepted: 2 August 2023 Published online: 2 January, TAPS 2024, 9(1), 42-48 https:\/\/doi.org\/10.29060\/TAPS.2024-9-1\/SC2997 Rahizan Zainuldin1 &amp; Heidi Siew Khoon Tan1,2 1Health and Social Sciences Cluster, Singapore Institute of Technology, Singapore; 2Pre-Professional Education Office, Tan Tock Seng Hospital, Singapore Abstract Introduction: Singapore Institute of Technology\u2019s undergraduate (UG) occupational therapy (OT) and physiotherapy [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/\" \/>\n<meta property=\"og:site_name\" content=\"The Asia Pacific Scholar\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-02T00:13:10+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/\",\"url\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/\",\"name\":\"Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar\",\"isPartOf\":{\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/#website\"},\"datePublished\":\"2023-11-27T05:53:11+00:00\",\"dateModified\":\"2024-04-02T00:13:10+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/medicine.nus.edu.sg\/taps\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Entrustable Professional Activities implementation in undergraduate allied health therapy programs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/#website\",\"url\":\"https:\/\/medicine.nus.edu.sg\/taps\/\",\"name\":\"The Asia Pacific Scholar\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/medicine.nus.edu.sg\/taps\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/","og_locale":"en_US","og_type":"article","og_title":"Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar","og_description":"Submitted: 24 January 2023 Accepted: 2 August 2023 Published online: 2 January, TAPS 2024, 9(1), 42-48 https:\/\/doi.org\/10.29060\/TAPS.2024-9-1\/SC2997 Rahizan Zainuldin1 &amp; Heidi Siew Khoon Tan1,2 1Health and Social Sciences Cluster, Singapore Institute of Technology, Singapore; 2Pre-Professional Education Office, Tan Tock Seng Hospital, Singapore Abstract Introduction: Singapore Institute of Technology\u2019s undergraduate (UG) occupational therapy (OT) and physiotherapy [&hellip;]","og_url":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/","og_site_name":"The Asia Pacific Scholar","article_modified_time":"2024-04-02T00:13:10+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/","url":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/","name":"Entrustable Professional Activities implementation in undergraduate allied health therapy programs - The Asia Pacific Scholar","isPartOf":{"@id":"https:\/\/medicine.nus.edu.sg\/taps\/#website"},"datePublished":"2023-11-27T05:53:11+00:00","dateModified":"2024-04-02T00:13:10+00:00","breadcrumb":{"@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/entrustable-professional-activities-implementation-in-undergraduate-allied-health-therapy-programs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/medicine.nus.edu.sg\/taps\/"},{"@type":"ListItem","position":2,"name":"Entrustable Professional Activities implementation in undergraduate allied health therapy programs"}]},{"@type":"WebSite","@id":"https:\/\/medicine.nus.edu.sg\/taps\/#website","url":"https:\/\/medicine.nus.edu.sg\/taps\/","name":"The Asia Pacific Scholar","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/medicine.nus.edu.sg\/taps\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues\/72299","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues"}],"about":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/types\/issues"}],"wp:attachment":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/media?parent=72299"}],"wp:term":[{"taxonomy":"issues_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues_category?post=72299"},{"taxonomy":"archive_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/archive_category?post=72299"},{"taxonomy":"issue_type","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issue_type?post=72299"},{"taxonomy":"volume_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/volume_category?post=72299"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}