Tele-therapy based tele-clinical learning in Speech and Hearing Sciences – Evaluation and validation of an evaluation tool
Submitted: 1 January 2025
Accepted: 12 August 2025
Published online: 7 October, TAPS 2025, 10(4), 44-54
https://doi.org/10.29060/TAPS.2025-10-4/OA3613
Dinushee Atapattu-Bakmeewewa1, Bhagya Devagiri1, Gayanthi Kodituwakku1 & Madawa Chandratilake2
1Department of Disability Studies, Faculty of Medicine, University of Kelaniya, Sri Lanka; 2Department of Medical Education, Faculty of Medicine, University of Kelaniya, Sri Lanka
Abstract
Introduction: Tele-clinical training is an effective approach, increasingly adopted post-pandemic and in resource-limited settings. However, it requires systematic development. This study details the first-time implementation of a tele-clinical training in an undergraduate Speech and Hearing Sciences programme, exploring student experiences and validating a novel evaluation tool, specifically designed for tele-clinical training programmes.
Methods: The study used a mixed-method approach. Quantitative data were gathered from 128 students using the developed 23-item Kelaniya Tele-Clinical Evaluation Tool (KeTCET), which covers three broad areas: Learning Environment, Supervisory Attributes, and Telehealth Teaching Practices. Qualitative insights from 13 participants were thematically analysed. The tool was validated for reliability and psychometric robustness using expert feedback and statistical evidence.
Results: Quantitative analysis showed high domain scores: Learning Environment 80.64%, Supervisory Attributes 81.67%, and Telehealth Teaching Practices 80.31%. Strong positive correlations between domains (r > 0.86, p < 0.001) indicated interconnectedness. The 23-item evaluation tool demonstrated high internal consistency (Cronbach Alpha = 0.98) and a single-factor structure (Eigenvalue = 17.12, 74.44% variance explained). Qualitative data highlighted strengths in supervisor interaction and resource availability, also noting challenges such as issues in connectivity and limited peer learning. Students appreciated structured feedback and supervisor presence during tele-clinical sessions.
Conclusions: The successful development of a tele-clinical programme requires consideration of multiple elements broadly categorised as pedagogical environment, supervisory characteristics, and virtual teaching practices. Well-structured programmes can effectively meet training needs in resource-limited settings, although strengths and challenges may vary across learning environments. The validated 23-item KeTCET offers a reliable framework for evaluating and improving tele-clinical programmes.
Keywords: Tele-clinical Programmes, Tele-clinical Supervision, Speech and Language Therapy, Audiology, Tele-clinical Evaluation, Tool Development, Undergraduate Clinical Training, KeTCET
Practice Highlights
- Tele-Practice based clinical programmes can be delivered successfully even in countries with limited resources.
- Robust planning is required to ensure that tele-clinical programmes address specific training needs and satisfy student expectations.
- Incorporating virtual clinical training modules into the regular curriculum can effectively address some of the barriers students have identified in tele-clinical learning.
- The unique features of tele-clinical training should guide the formulation of tailored guidelines and supervisory models for the virtual format.
- The evaluation of tele-clinical programmes is most effective when customised tools are developed to incorporate elements of the virtual format of training.
I. INTRODUCTION
The COVID-19 pandemic necessitated a global shift to online platforms in healthcare and education. Higher education institutions implemented online teaching methods, including webinars and interactive sessions (Hameed et al., 2020), while healthcare education adopted tele-medicine as a platform to continue clinical training, ensuring graduate preparedness for professional practice. Speech and language therapy and audiology professionals swiftly utilised tele-therapy, a method previously endorsed by the American Speech-Language-Hearing Association (ASHA, n.d.). This model of service delivery employs synchronous, asynchronous, and hybrid methods, tailored to patient needs and available resources. Beyond the pandemic, tele-medicine programmes offer enduring benefits, including improved access to care for remote and underserved populations, enhanced patient satisfaction and cost-effectiveness (Car et al., 2020). The World Health Organization emphasises the role of tele-medicine in broadening healthcare access, especially for people in remote areas and underserved communities (WHO, 2022).
Tele-clinical programmes, that is, clinical training conducted using tele-therapy have proven to be an effective method in clinical teaching and skills training. Considerable evidence demonstrates the tele-clinical programmes can be successfully used for clinical training, not limiting it to practical skills (Anderson et. al., 2023) but also addressing attitudinal changes (Wearne et. al., 2015) and clinical soft skills (Bramstedt et. al., 2014; Liu et. al., 2022).
Clinical supervision, distinct from classroom teaching, involves case-based learning, critical thinking, and professional behaviour modelling (Council of Academic Programmes in Communication Sciences and Disorders (CAPCSD), 2013). Traditionally conducted face-to-face clinical supervision shifted to tele-clinical supervision during the pandemic, utilizing a variety of strategies (Shawwa, 2023). However, much of the available literature on tele-supervision does not clearly state whether important aspects of clinical teaching, such as supervisor–student relationships and feedback (Kilminster & Jolly, 2000), were considered during programme design.
Evidence suggests that the effectiveness of tele-supervision depends significantly on the qualities of both the supervisor and the supervisee (Martin et al., 2017). Positive supervisory relationships, characterised by structure and support (Martin et al., 2014) are achievable in both virtual and face-to-face formats (Reese et al., 2009). Effective tele-supervision also depends on communication strategies, supervisor availability, and feedback models (Gibson et al., 2007; Snowdon et. al., 2019). Technological barriers, such as poor connectivity and equipment issues, can hinder outcomes, necessitating proactive solutions (Martin et al., 2017; Reese et al., 2009; Tarlow et al., 2020).
Systematic evaluation of student experiences in tele-clinical programmes is essential to understand their effectiveness. Most studies that report on tele-clinical programmes in allied health sciences (e.g., Bacon et al., 2023; Snowdon et al., 2019) and medicine (e.g,. Pit et al., 2021; Wearne et al., 2015) rely primarily on qualitative interview data. Ideally, such qualitative data should be supplemented with the use of a validated and reliable tools specifically designed to evaluate a virtual model of clinical training. This ensures that tele-clinical learning meets the professional standards and training requirements of audiology and speech and language therapy. The objectives of this study were to evaluate student experiences in an undergraduate Speech and Hearing Sciences tele-clinical training programme, and to validate a feedback tool to evaluate similar tele-clinical programmes.
II. METHODS
A. Context and Setting
The BSc (Hons) Speech and Hearing Sciences is a full-time, four-year undergraduate programme. The qualification allows graduates to practice as speech and language therapists or audiologists following registration at the national medical regulatory body. The programme consists of theoretical classroom-based sessions, synchronous to intensive supervised clinical training offered across the four years of study. Speech and Language Therapy (SLT) undergraduates are trained to work with communication and swallowing disorders while audiology undergraduates train in the detection and management of hearing loss, across the life span.
The data gathered in this study reflects experiences from the pandemic period, when clinic and hospital-based teaching was significantly limited. For almost two and a half years since the commencement of the pandemic, SLT and audiology service provision shifted fully into a tele-therapy programme. Simultaneously, students were enrolled in a tele-clinical programme, offered two to three times per week, where they worked with the patient under the supervision of an academic or qualified clinician. All sessions took place using the Zoom platform, which was made freely available to students by the university. Tele-therapy for adult patients requiring SLT services was delivered primarily using a synchronous method and for paediatric clients using an asynchronous or a mixed method. Audiology clinical services were primarily synchronous. The tele-clinical training was designed to align with the method of tele-therapy (Table 1).
|
Format |
Synchronous Method |
Asynchronous Method |
Hybrid Method |
|
Tele-therapy |
Conducted in real time using audio or video interactive sessions. |
Clinical management through stored images and captured data. |
Combines both synchronous and asynchronous methods. |
|
Tele-clinical Supervision |
Students conduct session. Supervisor joins in. Feedback is provided simultaneously and after session. |
Students join session. Supervisor shares recorded videos and relevant clinical information/documentation. Students are given time to reflect. |
Students conduct session. Supervisor joins in. Following a short real-time session, a recorded video is watched together. A discussion follows. |
Table 1. Modes of Tele-therapy and tele-supervision delivery
The general arrangement of a synchronous session was that the patient, student and supervisor joined the session at a mutually agreed time, but from three separate locations. Material for the therapy session, if required, was developed and shared on the screen by the student. For paediatric clients, parents arranged the toys needed. In audiology, students gathered patient data through interviews and questionnaires with limited use of conventional hearing tests. Auditory verbal training (AVT sessions) in audiology followed a similar format to SLT synchronous sessions. The supervisor remained a silent observer unless intervention was required. In all sessions, supervision concluded with an interactive patient discussion, facilitated by the supervisor using Zoom features such as whiteboard, break out rooms etc.
The evaluation of the tele-clinic programme was conducted using mixed methods by collecting students’ perceptions quantitatively (Phase I) and qualitatively (Phase II).
B. Phase 1- Development of Evaluation Tool and Quantitative Feedback
The quantitative evaluation of the tele-clinical programme was conducted with the aim of developing and validating a standardised tool for evaluating similar programmes.
1. Tool Development
As there are no existing tools available to evaluate SLT or audiology clinical programmes, whether face-to-face or virtual, a new evaluation tool was developed based on the Clinical Learning Environment, Supervision and Nurse Teacher evaluation scale (CLES +T ) (Mikkonen et al., 2017) and the Nursing Clinical Facilitator Questionnaire (NCFQ) (Espeland & Indrehus, 2003). The resulting 23-item tool, named the Kelaniya Tele-Clinical Evaluation Tool (KeTCET), was designed to map onto three primary domains: pedagogical/learning environment (LE; 9 items), supervisory relationship (SA; 6 items), and telehealth teaching practices (TTP; 8 items). The stem question used here was, how often did you experience this aspect in the online clinical learning sessions provided for the SHS programme during university closure? (Table 2). Participants rated each item on a 5-point Likert scale (0 – never, 1 – rarely, 2 – sometimes, 3 – often and 4 – always).
To enhance face and content validity, a panel of 10 experts in speech and language therapy and/or audiology rated the tool items on a five-point scale for [a] content appropriateness, [b] relevance, and [c] technical accuracy (1 = Very Low, 5 = Very High). Experts could also provide comments to refine the items. The panel scored the items high across all three aspects (mean[a]=4.8; mean[b]= 4.8; mean[c]=4.7). A measure of item relevance, I-CVI (Item- Content validity Index) scores for all items (n=23) were > 0.9. Minor language adjustments suggested were incorporated. The tool was then translated into Sinhala and Tamil and pre-tested with five students (three Sinhala speakers and two Tamil speakers) to confirm clarity and translation accuracy.
2. Study Participants
All 155 SLT undergraduate students in the SLT and audiology programmes who had attended at least 80% of the tele-clinical training sessions were considered eligible for participation in phase I. All eligible students were invited to participate in the study. At the time of data collection, these students were in their second, third, and fourth years of study. The minimum sample size required was calculated based on the recommended item-to-response ratio of 1:5 for factor analysis (Bujang et al., 2012; Gorsuch, 1983), requiring at least 115 responses. A total of 128 students responded (82.6%) to phase I.
|
Learning Environment |
|
1. Professionalism and mutual trust |
|
2. Enabling identity formation and promoting learning |
|
3. Developing relationships with supervisor and peers |
|
4. Optimised logistics and access to an interactive virtual learning platform |
|
5. Mechanism for constructive and timely feedback |
|
6. Encouraging autonomy in learning |
|
7. Promoting teamwork |
|
8. Equity and equal opportunity to participate and learn |
|
9. Known session structure |
|
Supervisor Attribute |
|
1. Expertise |
|
2. Ability to integrate taught content with remote clinical learning |
|
3. Supervision skills including timely feedback |
|
4. Communication skills to suit virtual training |
|
5. Preparation |
|
6. Familiarity (knowing the supervisor through face-to-face contact priorly |
|
Telehealth Teaching Practices |
|
1. Patient care and rapport building with the patient with a virtual space |
|
2. Learning with virtual clinical encounters |
|
3. Dedicated or adapted resources to suit virtual learning |
|
4. Clinical documentation development and maintenance for virtual learning |
|
5. Creating meaningful learning situations |
|
6. Supervision and personalised attention |
|
7. Peer learning |
|
8. Competency marking for virtual learning/ Adapted assessment methods |
Table 2. List of 23 items included in the developed tool
3. Data Collection
The participant information sheet and the online-converted 23-item tool were disseminated to participants through a link shared by an independent assistant lecturer, who was not a teacher on the programme, in order to avoid bias and any undue pressure to participants. In the first section of the online response form, participants provided written, informed consent by clicking on the ‘I agree to participate’ icon. At the time of evaluation, all students had received a minimum of 18 months training through the tele-clinical programme.
4. Data Analysis
The reported frequency of student experience was dichotomised as ‘never to sometimes’ (0-2) and ‘often or always’ (3 and 4). The initial analysis involved generating item-wise dichotomised frequencies to identify the aspects most frequently experienced in the offered programme. Subsequently, evidence supporting the validity and reliability of the evaluation tool was obtained through responses, assessed using internal consistency (Cronbach’s alpha), correlations between subjectively identified domains, and exploratory factor analysis.
C. Phase II – Qualitative evaluation of the Programme
1. Participants
In Phase II, 10% of the population (n= 13) who participated in Phase I of the study were purposively selected. These students represented the socio-demographic and educational characteristics of the population.
2. Data Collection
The selected participants were invited to participate in a focus group discussion, which was conducted by the researchers in native languages. The discussion lasted for approximately 65 minutes. It was audio-recorded and transcribed verbatim.
3. Data Analysis
Data analysis was guided by the procedure outlined by Braun and Clarke (2006). Transcripts were first coded by two team members (GK and BD) and reviewed by the third (DB). Data collection and analysis happened synchronously, where new codes were identified after each interview. Thematic analysis was inductively performed; themes were not identified a priori but emerged from the data. These themes reflected the subjective domains of the questionnaire but were not limited to them, allowing for the exploration of novel insights.
III. RESULTS
The findings are reported in terms of participants’ characteristics, students’ perceptions about the programme, and the psychometric properties of the evaluation tool.
A. Participants Characteristics
A total of 128 responded to phase I of the study (82.6%); 122 females and 6 males. The mean age was 24.43 years (SD= l4.24). 98 students were from the Speech and Language Therapy programme and 30 were from the Audiology programme. Out of the respondents, 48 were in their second year, 49 in their third year and 31 in their final year. The composition of the 13 students who participated in the focus group discussion is as follows: 12 females and 1 male student; four students from the second year, four students from the third and five students from the final year.
B. Perception about the Tele-clinical Programme
Quantitative analysis showed that the tele-clinical programme achieved high average scores (>80%) across all domains. Teachers appeared to have fostered professionalism and equity in the virtual learning environment, prepared well, and brought in meaningful learning situations. However, they may need to focus on building better familiarity with the student, encouraging peer learning and reflecting on strategies to better develop clinical skills in the virtual learning environment (Table 3).
|
Domain |
Max Domain |
Mean Score |
% Score |
High-Scoring |
Low-Scoring |
|
Learning |
36 |
29.03 |
80.64% |
Professionalism, |
Supervisor familiarity |
|
Supervisory |
24 |
19.6 |
81.67% |
Supervisor |
Facilitating peer |
|
Telehealth Teaching |
32 |
25.7 |
80.31% |
Meaningful |
Clinical skill |
Table 3. Domains-level perception scores
In the correlational analysis, a strong interconnectedness between the three domains was observed which suggests that improvements or strengths in one domain are likely to support and enhance the effectiveness of the others (Table 4).
|
Domains |
Learning Environment |
Supervisory Attributes |
Telehealth Teaching |
|
Learning Environment |
1 |
0.876 (p < 0.001) |
0.881 (p < 0.001) |
|
Supervisory Attributes |
0.876 (p < 0.001) |
1 |
0.863 (p < 0.001) |
|
Telehealth Teaching |
0.881 (p < 0.001) |
0.863 (p < 0.001) |
1 |
Table 4. Correlation between subjective domains of the evaluation tool
In the correlational analysis, a strong interconnectedness between the three domains; LE, SA and TTP was observed which suggests that improvements or strengths in one domain are likely to support and enhance the effectiveness of the others (Table 3).
The qualitative data highlight both the strengths and challenges of the tele-clinical programme. Participants in the tele-clinical programme highlighted various experiences across the three subjective domains, Learning Environment (LE), Supervisory Attributes (SA), and Telehealth Teaching Practices (TTP). These findings help explain the pattern of rating of items observed in the qualitative analysis.
Under LE, students appreciated the time supervisors took to interact with them, fostering a sense of connection. “The interaction with the lecturer was good. We had an opportunity for that” (P17). However, many noted that the lack of structure in sessions hindered effective task management. “If it were more structured, and if we had a better plan to submit documents within like two hours after the session, that would have been ideal” (P94). Virtual clinics also presented environmental challenges, with frequent disruptions due to background noise or technical issues. “Sometimes there was so much noise we couldn’t focus” (P52). Additionally, students had to creatively adapt therapy methods for the virtual format, often requiring supervisor feedback. “We really had to think of different ways to test and manage hearing issues” (P49).
In the SA domain, participants valued supervisors who provided context before and after sessions, which clarified the learning process. “Supervisors gave us a description about the client before they came into the session and then did the same after the session” (P3). Supervisory styles had a significant impact on student confidence. For example, students noted that when supervisors turned on their video cameras, their visible presence positively influenced their performance.
“Some supervisors turned on their videos. It made us feel confident” (P23). Students also expressed a need for independent practise opportunities, even within the limitations of tele-clinics. “Supervisors allowed us to do exactly what we did in FTF sessions” (P19).
For TTP, students appreciated resources like a shared material library, which facilitated session preparation. “The best part of it was the material library that the staff made for us” (P12). However, connectivity issues, such as poor internet connections and power outages, often disrupted sessions. “It was terrible when my clinical partner had a very poor connection” (P53). Technical limitations, such as using small phone screens or faulty laptops, further impeded learning. “Some didn’t have laptops and used phones. The screen is small so we can’t see” (P19). Patient-related factors, like poor camera positioning or noisy environments, added stress to students. “Parents kept the tab on a table, then sat on the floor to play. So, we couldn’t see anything” (P23).
In summary, it appeared that while students valued interaction, feedback, and innovative resources, they faced issues with session structure, connectivity, and technical limitations. Supervisory presence and adaptability were crucial for building confidence and overcoming challenges.
|
Item |
Component 1 |
|
|
SA3 |
Supervision skills including timely feedback |
.923 |
|
SA2 |
Ability to integrate taught content with remote clinical learning |
.900 |
|
SA1 |
Expertise |
.893 |
|
LE5 |
Mechanism for constructive and timely feedback |
.888 |
|
SA4 |
Communication skills to suit virtual training |
.884 |
|
TTP6 |
Supervision and personalised attention |
.880 |
|
LE8 |
Equity and equal opportunity to participate and learn |
.876 |
|
TTP5 |
Creating meaningful learning situations |
.874 |
|
LE3 |
Developing relationships with supervisor and peers |
.871 |
|
SA5 |
Preparation |
.871 |
|
TTP1 |
Patient care and rapport building with the patient with a virtual space |
.864 |
|
TTP4 |
Clinical documentation development and maintenance for virtual learning |
.861 |
|
TTP2 |
Learning with virtual clinical encounters |
.859 |
|
LE2 |
Enabling identity formation and promoting learning |
.858 |
|
LE6 |
Encouraging autonomy in learning |
.856 |
|
TTP7 |
Peer learning |
.856 |
|
TTP3 |
Dedicated or adapted resources to suit virtual learning |
.851 |
|
LE7 |
Promoting teamwork |
.851 |
|
LE9 |
Known session structure |
.850 |
|
TTP8 |
Competency marking for virtual learning/ Adapted assessment methods |
.842 |
|
SA6 |
Familiarity (knowing the supervisor through face-to-face contact priorly |
.836 |
|
LE1 |
Professionalism and mutual trust |
.812 |
|
LE4 |
Optimised logistics and access to an interactive virtual learning platform |
.775 |
a Extraction Method: Principal Component Analysis only one component was extracted. Cannot be rotated.
Table 5. The Principal Component Analysis of the 23 items of the evaluation tool
C. The Psychometric Properties of the Tool
The internal consistency of the 23 items, as measured by Cronbach’s alpha, was very high (α = 0.98). While a high alpha value may indicate internal consistency, it can also suggest item redundancy. To assess this, inter-item and item-total correlations were examined. All items showed acceptable item-total correlations (>0.3), suggesting minimal redundancy. Although only one factor was extracted in the principal component analysis (Eigenvalue = 17.12), varimax rotation was initially applied during the exploratory analysis phase to evaluate whether multiple factor structures might emerge. This step was performed prior to confirming the single-factor solution. Since all items loaded strongly (>0.7) onto a single component and no additional eigenvalues exceeded 1 (Table 5), the use of rotation was ultimately deemed unnecessary, and only the unrotated solution is reported. Although the tool was originally structured around three subdomains (Learning Environment, Supervisory Attributes, and Telehealth Teaching Practices), exploratory factor analysis revealed a single latent factor structure. This suggests that in the context of tele-clinical learning, these domains may not function as distinct constructs but rather as interrelated facets of a unified student experience. While this does not contradict theoretical expectations, it highlights the integrated nature of tele-clinical learning, where pedagogical, supervisory, and teaching practice components coalesce in a single virtual training environment.
The data gathered for this study and analysed above can be accessed by readers for viewing purposes only, from the Figshare data repository at https://doi.org/10.6084/m9.figshare.28116863 (Atapattu-Bakmeewewa et. al., 2025).
IV. DISCUSSION
This study evaluated undergraduate SLT students’ experiences in a tele-clinical programme revealing positive outcomes with domain scores exceeding 80%. Qualitative insights highlighted professionalism, equity and meaningful learning to be the strengths of this programme. The validated 23-item tool demonstrated strong psychometric properties, with high reliability (α = 0.98) and a single-factor structure, supporting its adaptability.
A. Student Experiences in a Tele-Clinical Programme
Although prior studies have shown a preference for face-to-face clinical teaching (Bacon et al., 2023), findings from our study add to growing evidence that support a shift in thinking. Our tele-clinical programme was implemented over an extended period and was well-established at the time of evaluation. This may have contributed to higher acceptance scores reported. Evaluating the effectiveness of virtual clinical training has often relied on either qualitative research (e.g., Gammon et al., 1998; Gibson et al., 2007) or quantitative surveys (e.g., Heckner & Giard, 2005). This study employed a robust mixed-methods approach, analysing quantitative data from 128 participants and complementing it with qualitative insights from 13 randomly selected individuals. High ratings across the 23 evaluated items, with over 80% agreement, suggest that delivering an effective tele-clinical programme is feasible, even in resource-limited contexts. Qualitative findings, however, highlight the importance of thorough planning and holistic design, also the need to integrate elements from multiple domains.
Our findings indicated that students had similar expectations in the virtual programme as those in face-to-face training, particularly support for developing online materials. Learning material such as scaffolds and scripts have been identified by students as enablers of tele-clinical learning (Bacon et al., 2023). Gracious et al. (2024) report that the versatility of virtual environments may at times lead to unrealistic expectations, such as improved grades or increased institutional support. Unmet expectations may in turn be associated with dissatisfaction with the virtual tele-clinical concept. We therefore comprehensively discussed student expectations before the programme delivery to enhance the acceptance and effectiveness of virtual clinical programmes. Technical disruptions, reduced reading of non-verbal cues, background noise, patient camera placement and limited IT literacy were shared challenges (See, Gibson et al., 2007; Tarlow et al., 2020). Training (Pit et al., 2021) and pre-session briefings (Heckner & Giard, 2005) are considered effective strategies to mitigate such barriers.
There is evidence that supervisory familiarity, that is prior supervisor contact, improves outcomes in tele-clinical programmes (Martin et al., 2018). Supervisor familiarity was included as an item in our tool but was not a high-scoring attribute possibly because our tele-clinical programme was taught by permanent academic staff, already familiar to the students. As a result, students may have focused more on the other attributes. Participants, however, emphasised the need for supervisory traits that foster supervisor-student engagement. This aligns with findings from Reese et al. (2009), who reported no significant differences in supervisory satisfaction between virtual and face-to-face formats, if the supervisor maintained a supportive attitude.
Students in our study not only advocated for equal participation and autonomy within the tele-clinical programme (Gracious et al., 2024; Tarlow et al., 2020) but also used it as a descriptor when differentiating between different supervisory styles. This reflects findings by Miller and Gibson (2004) who emphasised the importance of power balance and involvement in clinical supervision, which may hold even greater significance in virtual settings. The study further suggests that the successful delivery of tele-clinical programmes depends on trainee characteristics; more mature students or those with prior face-to-face experience, may adapt better (Martin et al., 2023; Reese et al., 2009). Integrating virtual clinical modules into undergraduate curricula presents a viable strategy for providing students with essential tele-clinical experience. This would additionally address evolving training demands, support the development of competencies among future therapists and contribute to a sustainable transformation in patient access to healthcare services (Iancu et al., 2020; Jeffries et al., 2022).
Our findings indicate that educators overlooked certain elements, such as promoting peer learning. This highlights the importance of robust planning in tele-clinical practice. Without it, critical elements such as opportunities for continuing professional development (CPD), skills around ethics, concepts of multidisciplinary collaboration and patient and family advocacy may be inadvertently overlooked, especially in simulated environments (Jeffries et al., 2022). Such elements if missed, can lead to a potentially negative impact on the long-term professional growth of learners. Recognizing and addressing the pitfalls in tele-clinical practice, as applicable to the setting in which it is delivered, is a crucial step to optimizing its effectiveness. Tutors must assess training needs, patient suitability, human resources, and available infrastructure for both teachers and trainees, during programme development. Research shows that integrating synchronous (live) and asynchronous (self-paced) learning helps make tele-clinical programmes more effective (Perle & Zheng, 2024; Snowdon et al., 2019).
The unique features of tele-clinical training should guide the formulation of context-specific guidelines and supervisory frameworks (Gibson et al., 2007), taking in to account the unique training requirements of allied-health professions such as speech and language therapy, audiology, occupational therapy, and physiotherapy (Bacon et al., 2023), all of which require a combination of direct and reflective supervision.
B. Development of the Evaluation Tool
Our findings suggest that the success of a tele-clinical programme relies on the integrated consideration of the pedagogical environment, supervisory attributes and virtual teaching practices. Data showed these aspects appeared to be highly complementary to each other as the statistical analyses strongly suggest that they are highly interconnected and strongly correlated. The 23-item single-domains tool, which we wish to name as KeTCET (Kelaniya Tele-Clinical Evaluation Tool), has provided basic but strong psychometric evidence as a tool for evaluating tele-clinical programmes. The KeTCET aligns closely with established practices in educational tool design and draws on the strengths of existing instruments in clinical education evaluation. Its 23-item structure is consistent with tools like the (CLES+T) scale, which features 34 items across subdomains such as pedagogical environment and supervisory attributes (Saarikoski et al., 2008), and the Manchester Clinical Supervision Scale (MCSS), which comprises 26 items to evaluate supervision quality (Winstanley & White, 2011). The compact structure of KeTCET balances comprehensiveness and practicality, making it an efficient yet thorough evaluation tool.
KeTCET’s development followed a rigorous validation process involving item selection from already existing validated instruments and expert feedback for content appropriateness, cultural relevance, and technical accuracy. This aligns with recommended methodologies for reliable tool development (DeVellis & Xie, 2021). The tool underwent pilot testing to ensure clarity and relevance, a process comparable to the development of other notable tools like the Surgical Mini-CEX and the Physician Work Environment Survey (Friedberg et al., 2014; Norcini et al., 2003). KeTCET demonstrated high internal consistency (α = 0.98), surpassing the widely accepted reliability benchmark (Nunnally, 1978) and factor analysis confirmed a single-factor structure (Eigenvalue = 17.12, 74.44% variance explained), supporting its psychometric robustness (Kline, 1999).
The domains assessed by KeTCET, pedagogical environment, supervisory traits, and virtual teaching practices, mirror the constructs of established tools but are uniquely tailored to address the challenges of tele-clinical education. By integrating these domains synchronously, KeTCET effectively evaluates the complexities of virtual supervision, bridging a gap left by tools primarily designed for face-to-face settings. Its strong psychometric properties establish it as a reliable and effective instrument for assessing tele-clinical programmes, particularly in speech and hearing sciences.
While existing tools like CLES+T and MCSS are used successfully to evaluate traditional clinical education and supervision, KeTCET extends this utility to tele-clinical settings. Its tailored approach involving a synchronous integration of pedagogical elements, supervisory attributes, and virtual teaching practices positions it as a highly appropriate tool for evaluating tele-clinical programmes. The initial psychometric evidence supporting KeTCET underscores its potential to advance the evaluation of tele-clinical supervision, ensuring robust assessments that inform programme development and improvement.
Beyond individual programme evaluation, KeTCET shows potential as a comparison tool for checking institutional programmes and as a starting point for changes in clinical education. Its organised framework could help make evaluation practices more uniform across institutions and different settings. This may lead to fairer and more consistent assessments in tele-clinical training.
C. Future Directions
While the study highlights the potential use of telehealth for medical education, further improvements could consider including supervisor experiences for a more comprehensive perspective. Future work can also expand to involve diverse programmes and evaluating long-term impacts of tele-clinical programmes. Validation in varied contexts and exploration of peer learning mechanisms would enhance its applicability and effectiveness in clinical training.
V. CONCLUSION
Tele-clinical supervision programmes offer a viable solution to train healthcare professionals, especially in resource-limited settings. This study shows their potential for high student acceptance and effectiveness when systematically designed. Addressing pedagogical environments, supervisor traits, and virtual teaching practices with synchronous and asynchronous elements is crucial. The validated 23-item tool (KeTCET) provides a strong framework for the evaluation of tele-clinical programmes, paving the way for future longitudinal research on long-term outcomes.
Notes on Contributors
Dinushee Atapattu-Bakmeewewa, Bhagya Devagiri, Gayanthi Kodituwakku and Madawa Chandratilake contributed to the conceptualization and implementation of this research and have also contributed to the writing of this manuscript.
Ethical Approval
This study was reviewed and approved by the Ethical Review Committee of the Faculty of Medicine, University of Kelaniya, Sri Lanka (Ref. no. P-84-08-2021).
Data Availability
The data set generated for the quantitative part of this study is available at the following URL:
https://doi.org/10.6084/m9.figshare.28116863.
Acknowledgement
The authors wish to thank all students for their participation and Emeritus Prof. Pathmeswaran for his guidance in the analysis of data.
Funding
This project and manuscript did not receive any funding.
Declaration of Interest
None of the authors has any conflict of interest or financial interest to declare.
References
Anderson, H. K., Hayes, S., Smith, J. P., & Currie, S. (2023). Comparing two methods of clinical supervision. Internet Journal of Allied Health Sciences and Practice, 21(2), 10. https://doi.org/10.46743/1540-580X/2023.2319
Atapattu Bakmeewewa, A. D. S., Devagiri, B., Kodituwakku, G. K., & Chandratilake, M. (2025). Tele-clinical item rating_dataset.xlsx (Version 1). figshare. https://doi.org/10.6084/m9.figshare.28116863
Bacon, R., Hopkins, S., Georgousopoulou, E., Nahon, I., Hilly, C., Millar, C., Flynn, A., Smillie, L., Chapman, S., & Brown, N. (2023). While allied health students prefer face-to-face clinical placement, telehealth can support competency development: Results from a mixed-methods study. Frontiers in Medicine, 10, 1151980. https://doi.org/10.3389/fmed.2023.1151980
Bramstedt, K. A., Prang, M., Dave, S., Shin, P. N. H., Savy, A., & Fatica, R. A. (2014). Telemedicine as an ethics teaching tool for medical students within the nephrology curriculum. Progress in Transplantation, 24(3), 294–297. https://doi.org/10.7182/PIT2014289
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Bujang, M. A., Ab Ghani, P., Soelar, S. A., & Zulkifli, N. A. (2012, September). Sample size guideline for exploratory factor analysis when using small sample: Taking into considerations of different measurement scales. International Conference on Statistics in Science, Business and Engineering (ICSSBE), (pp. 1-5). IEEE. https://doi.org/10.1109/ICSSBE.2012.6396605
Car, J., Koh, G. C. H., Foong, P. S., & Wang, C. J. (2020). Video consultations in primary and specialist care during the COVID-19 pandemic and beyond. BMJ, 371. https://doi.org/10.1136/BMJ.M3945
Council of Academic Programmes in communication sciences and disorders. (2013, April 11). White paper: Preparation of speech-language pathology clinical educators. American Speech-Language-Hearing Association. https://wordpressstorageaccount.blob.core.windows.net/wp-media/wp-content/uploads/sites/1023/2019/06/White-Paper-Prep-of-SLP-Clinical-Education-Final-April-11-2013.pdf
DeVellis, R. F., & Xie, Y. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.
Espeland, V., & Indrehus, O. (2003). Evaluation of students’ satisfaction with nursing education in Norway. Journal of Advanced Nursing, 42(3), 226–236. https://doi.org/10.1046/j.1365-2648.2003.02611.x
Friedberg, M. W., Chen, P. G., Van Busum, K. R., Aunon, F., Pham, C., Caloyeras, J., Mattke, S., Pitchforth, E., Quigley, D. D., Brook, R. H., Crosson, F. J., & Tutty, M. (2014). Factors affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. Rand Health Quarterly, 3(4), 1. https://pubmed.ncbi.nlm.nih.gov/28083306
Gammon, D., Sørlie, T., Bergvik, S., & Høifødt, T. S. (1998). Psychotherapy supervision conducted by videoconferencing: A qualitative study of users’ experiences. Journal of Telemedicine and Telecare, 4(SUPPL. 1), 33–35. https://doi.org/10.1258/1357633981931353
Gibson, A., Miller, R., & King, R. (2007). Staying connected: Video conferenced supervision for rural provisional psychologists. InPsych: The Bulletin of the Australian Psychological Society Ltd, 29(5), 16.
Gracious, P. D., Armah, J., Boateng, E. A., Bam, V., Dzomeku, V., Kyei-Dompim, J., Oklodu-Abbey, A. D., & Amponsah, A. K. (2024). Expectations, experiences and challenges of nursing students using the virtual learning medium during the COVID-19 pandemic: A descriptive phenomenological study. PLOS ONE, 19(3), e0299967–e0299967. https://doi.org/10.1371/JOURNAL.PONE.0299967
Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68(3), 532–560. https://doi.org/10.1207/s15327752jpa6803_5
Hameed, T., Husain, M., Jain, S. K., Singh, C. B., & Khan, S. (2020). Online medical teaching in COVID-19 era: Experience and Perception of Undergraduate Students. Mædica, 15(4), 440. https://doi.org/10.26574/MAEDICA.2020.15.4.440
Heckner, C., & Giard, A. (2005). A comparison of on-site and telepsychiatry supervision. Journal of the American Psychiatric Nurses Association, 11(1), 35–38. https://doi.org/10.1177/1078390305275602
Iancu, A. M., Kemp, M. T., & Alam, H. B. (2020). Unmuting medical students’ education: Utilizing telemedicine during the COVID-19 pandemic and beyond. Journal of Medical Internet Research, 22(7), e19667–e19667. https://doi.org/10.2196/19667
Jeffries, P. R., Bushardt, R. L., DuBose-Morris, R., Hood, C., Kardong-Edgren, S., Pintz, C., Posey, L., & Sikka, N. (2022). The role of technology in health professions education during the COVID-19 pandemic. Academic Medicine Journal of the Association of American Medical Colleges, 97(3S), S104–S109. https://doi.org/10.1097/ACM.0000000000004523
Kilminster, S. M., & Jolly, B. C. (2000). Effective supervision in clinical practice settings: A literature review. Medical Education, 34(10), 827–840. https://doi.org/10.1046/j.1365-2923.2000.00758.x
Kline, R. B. (1999). [Review of the book Psychometric theory (3rd ed.), by J.C. Nunally & I. H. Bernstein]. Journal of Psychoeducational Assessment, 17(3), 275-280. https://doi.org/10.1177/073428299901700307
Liu, Y., Guo, S., Yang, Z., Hirata, H., & Tamiya, T. (2022). A home-based tele-rehabilitation system with enhanced therapist-patient remote interaction: A Feasibility study. IEEE Journal of Biomedical and Health Informatics, 26(8), 4176–4186. https://doi.org/10.1109/JBHI.2022.3176276
Martin, P., Copley, J., & Tyack, Z. (2014). Twelve tips for effective clinical supervision based on a narrative literature review and expert opinion. Medical Teacher, 36(3), 201–207. https://doi.org/10.3109/0142159X.2013.852166
Martin, P., Hulme, A., Fallon, T., Kumar, S., McGrail, M., Argus, G., Gurney, T., & Kondalsamy-Chennakesavan, S. (2023). Impact of the COVID-19 pandemic on student supervision and education in health care settings: A state-wide survey of health care workers. Australian Journal of Rural Health, 31(3), 484–492. https://doi.org/10.1111/AJR.12969
Martin, P., Kumar, S., & Lizarondo, L. (2017). Effective use of technology in clinical supervision. Internet Interventions, 8, 35–39. https://doi.org/10.1016/J.INVENT.2017.03.001
Martin, P., Lizarondo, L., & Kumar, S. (2018). A systematic review of the factors that influence the quality and effectiveness of tele supervision for health professionals. Journal of Telemedicine and Telecare, 24(4), 271–281. https://doi.org/10.1177/1357633X17698868
Mikkonen, K., Elo, S., Miettunen, J., Saarikoski, M., & Kääriäinen, M. (2017). Clinical learning environment and supervision of international nursing students: A cross-sectional study. Nurse Education Today, 52, 73–80. https://doi.org/10.1016/J.NEDT.2017.02.017
Miller, R. J., & Gibson, A. M. (2004). Supervision by videoconference with rural probationary psychologists. International Journal of Innovation in Science and Mathematics Education, 11(1). https://openjournals.library.sydney.edu.au/CAL/article/view/6065
Nunnally, J. C. (1978). An overview of psychological measurement. In M. M. Katz, J.e. Barrett, & F. F. Williams (Eds.), Clinical diagnosis of mental disorders: A Handbook (pp. 97-146). Springer. https://doi.org/10.1007/978-1-4684-2490-4_4
Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003). The mini-CEX: A method for assessing clinical skills. Annals of Internal Medicine, 138(6), 476–481. https://doi.org/10.7326/0003-4819-138-6-200303180-00012
Perle, J. G., & Zheng, W. (2024). A primer for understanding and utilizing tele supervision with healthcare trainees. Journal of Technology in Behavioural Science, 9(1), 46–52. https://doi.org/10.1007/S41347-023-00322-5
Pit, S. W., Velovski, S., Cockrell, K., & Bailey, J. (2021). A qualitative exploration of medical students’ placement experiences with telehealth during COVID-19 and recommendations to prepare our future medical workforce. BMC Medical Education, 21(1). https://doi.org/10.1186/s12909-021-02719-3
Reese, R. J., Aldarondo, F., Anderson, C. R., Lee, S. J., Miller, T. W., & Burton, D. (2009). Telehealth in clinical supervision: A comparison of supervision formats. Journal of Telemedicine and Telecare, 15(7), 356–361. https://doi.org/10.1258/JTT.2009.090401
Saarikoski, M., Isoaho, H., Warne, T., & Leino-Kilpi, H. (2008). The nurse teacher in clinical practice: developing the new sub-dimension to the clinical learning environment and supervision (CLES) scale. International Journal of Nursing Studies, 45(8), 1233–1237. https://doi.org/10.1016/J.IJNURSTU.2007.07.009
Shawwa, L. (2023). The use of telemedicine in medical education and patient care. Cureus, 15(4). https://doi.org/10.7759/cureus.37766
Snowdon, D. A., Sargent, M., Williams, C. M., Maloney, S., Caspers, K., & Taylor, N. F. (2019). Effective clinical supervision of allied health professionals: A mixed methods study. BMC Health Services Research, 20(1). https://doi.org/10.1186/S12913-019-4873-8
Tarlow, K. R., McCord, C. E., Nelon, J. L., & Bernhard, P. A. (2020). Comparing in-person supervision and tele supervision: A multiple baseline single-case study. Journal of Psychotherapy Integration, 30(2), 383–393. https://doi.org/10.1037/INT0000210
Wearne, S. M., Teunissen, P. W., Dornan, T., & Skinner, T. (2015). Physical isolation with virtual support: Registrars’ learning via remote supervision. Medical Teacher, 37(7), 670–676. https://doi.org/10.3109/0142159X.2014.947941
Winstanley, J., & White, E. (2011). The MCSS-26: Revision of the Manchester clinical supervision scale using the rasch measurement model. Journal of Nursing Measurement, 19(3), 160–178. https://doi.org/10.1891/1061-3749.19.3.160
World Health Organization (WHO). (2022, November 10). WHO issues consolidated guide to running effective telemedicine services. WHO News. https://www.who.int/news/item/10-11-2022-who-issues-new-guide-to-running-effective-telemedicine-services
*D Atapattu Bakmeewewa
Department of Disability Studies, Faculty of Medicine
PO Box 6, Thalagolla road, Ragama, 11010 Sri Lanka
Email: dinushee@kln.ac.lk
https://doi.org/10.29060/TAPS.2025-10-4/TT004
Lambert Schuwirth
Professor of Medical Education
NewMedSchool, Australia
We are currently living in a time in which different assessment paradigms co-exist. There are contexts in which assessment is purely seen as a measurement, for instance national licensing. There are contexts in which assessment is predominantly judgement, such as in VIVAs and there are contexts in which these are combined to form an integral programmatic assessment for learning program.
Although a programmatic assessment for learning aims to combine both measurements and judgements, the manner in which all assessment data is synthesised and fed back to the learner is always through judgement and narratives. That is inevitable because numerical outcomes without added narratives are as meaningless as a scientific paper without an introduction, methods and discussion section and only the tables of the results. Numerical outcomes can only drive learning purely by punishment and reward and cannot provide the learner agency or support with meaningful self-regulation of their learning. Modern professionals, however, need capabilities to self-regulate their learning.
Assessment for learning therefore always needs to be programmatic – as opposed to formative assessment which can simply be a test that does not count.
But are narratives defensible? This is a common concern as we tend to trust quantitative outcomes more than qualitative. I find this odd. We trust healthcare as a system, even though the history, physical examination results, pathology and imaging reports and even contextualised lab values are all narratives, as are the diagnosis and management plan.
In an educational context, I would therefore plea that assessment should be more like a diagnostic and therapeutic relationship with the medical student. Assessment should guide them to become the best doctor they can be, and with our intake of the brightest and most hard-working young people the vast majority are. But what about the minority? Yes, they need to be identified as well but focusing an entire system on an issue with a low prevalence (the irremediable student) creates a huge NNT problem and is a waste of money and resources.
But assessment needs to be credible and fair. That is where programmatic assessment differs from a testing approach. Testing defines fairness as equality – everybody receives the same standardised test. Programmatic assessment defines fairness as equity – everybody receives the same quality of assessment. Just like we don’t push all patients through the same template in healthcare, but offer bespoke and high-quality diagnostic and therapeutic care, we should do the same with assessment.
Submitted: 10 March 2025
Accepted: 5 July 2025
Published online: 7 October, TAPS 2025, 10(4), 55-62
https://doi.org/10.29060/TAPS.2025-10-4/OA3690
Aaron Tigor Sihombing1,2, Antonia Kartika3,4 & Anglita Yantisetiasti2,5
1Department of Surgery, Division of Urology, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia; 2Hasan Sadikin General Hospital, Bandung, Indonesia; 3National Eye Center-Cicendo Eye Hospital, Bandung, Indonesia; 4Department of Ophthalmology, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia; 5Department of Anatomical Pathology, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia
Abstract
Introduction: Music preferences have been linked to personality traits, which in turn may influence career choices. This study explores the potential relationship between music genre preferences and medical specialty selections among residents at Padjadjaran University, Indonesia.
Methods: A cross-sectional survey was conducted among all residents trained in urology, ophthalmology, and anatomic pathology. Data collected included demographic characteristics, music genre preferences, and work habits related to music. Independent t-tests are used when data are normally distributed, whereas Kruskal-Wallis tests are used when data are not normally distributed.
Results: The study included 125 residents (19 pathology anatomy, 33 urology, 73 ophthalmology). Pop was the most preferred music genre across all specialties (48% in urology, 61% in ophthalmology, 52% in pathology anatomy). However, secondary preferences varied: rock (21%) was the second most popular among urology residents, jazz (10.9%) and indie (10.9%) among ophthalmology residents, and classical music (26%) among pathology anatomy residents. Demographic differences were noted, with pathology anatomy residents being older and urology residents having a higher proportion of males. Ethnic distribution was relatively consistent across specialties, primarily mixed ethnicity, Sundanese, and Javanese.
Conclusion: While pop music was the predominant preference across all specialties, secondary music preferences varied, potentially reflecting different personality traits associated with each specialty. The study’s findings are limited by its single-institution sample and cross-sectional design, necessitating further research with larger, more diverse populations to explore the underlying mechanisms linking music preferences to medical specialisation choices.
Keywords: Music Preferences, Medical Specialty Selection, Personality Traits
Practice Highlights
- Personality traits could predict specialty preferences among medical students.
- Music genre preferences are associated with personality traits, thus are drawn to particular type of music.
- Residents in different specialties distributed music genres differently.
I. INTRODUCTION
The notion that music genres reflect and influence personality traits is a topic of much debate and interest. Research has shown a correlation between musical preferences and personality traits, with certain genres being associated with specific characteristics (Andrews et al., 2022; Wang et al., 2024). For example, music in slow tempo and music in minor keys were significantly predicted by emotional stability and optimism, whereas music in fast tempo and music in major keys was significantly predicted by openness to experiences, introversion, and gender (Dobrota & Reić, 2014; Upadhyay et al., 2017). Some evidence suggests that individuals drawn to certain music genres may exhibit personality profiles that align with specific career paths. For instance, individuals who prefer classical music tend to score higher in openness and introversion—traits associated with analytical or solitary professions—while those who enjoy rock or pop may display extraversion and sensation-seeking behaviors, often linked to high-energy or interactive professions (Rentfrow & Gosling, 2003; Schäfer & Mehlhorn, 2017). Moreover, individuals with high levels of achievement tend to prefer music that reflects their professional identity, indicating a potential association between occupational roles and musical preferences (Knox & McDonald, 2017).
Similarly, in the field of medicine, there is a growing interest in understanding how personality traits may influence medical residency preferences. Studies suggest that certain personality types may be drawn to specific medical specialties, and this alignment could impact their satisfaction and performance within that field. This intersection of music, personality, and medical career choices highlights the complex ways in which our preferences and personalities shape and reflect our identities and professional paths.
Culture and environment have a profound effect on a person’s personality (Smaldino et al., 2019; Triandis & Suh, 2002). Culture provides a framework within which individuals develop beliefs, values, and behaviours that are in harmony with their societal norms. It shapes personality through language, customs, and social norms, which guide an individual’s actions and interactions. Environment, encompassing family dynamics, social relationships, and educational experiences, also plays a pivotal role in molding personality traits. As individuals navigate through different environmental contexts, their personalities adapt and evolve, reflecting the dynamic interplay between their innate dispositions and external influences. This complex interconnection suggests that personality is not a static entity but a fluid construct that changes over time, influenced by the cultural and environmental landscapes we inhabit.
Indonesia’s rich of cultures is indeed a testament to its diversity, with over 300 ethnic groups calling it home. This multicultural environment offers a unique blend of traditions, languages, and beliefs, which can significantly shape an individual’s personality. Exposure to diverse cultural practices and values can foster open-mindedness, adaptability, and a complex worldview. Research suggests that multicultural experiences can enhance creativity, reduce stereotypes, and provide a broader perspective on life. Moreover, individuals who navigate multiple cultures may develop a multicultural identity, integrating different cultural influences into their personal identity, which can contribute to their overall well-being and social harmony.
The exploration of a potential correlation between musical preferences and medical specialty choice in Indonesia is indeed a fascinating subject. Since music has been noted to affect personality, which in turn influences the choice of medical specialisation, Indonesia is a multicultural country, and this correlation is intriguing. As a result, this study aims to determine if there is a distribution difference between music genre preferences and healthcare specialisations in Indonesia.
II. METHODS
This research employed a cross-sectional study design, with total sampling of all Padjadjaran University resident utilising a comprehensive survey administered to all residents. The study population comprised residents specialising in three distinct medical disciplines: urology, ophthalmology, and anatomic pathology. All residents in urology, ophthalmology, and anatomic pathology were eligible to be included. Exclusion criteria included incomplete responses or refusal to provide consent. This selection allowed for a comparative analysis across specialties with varying degrees of procedural and cognitive demands. In this study we utilised total sampling, all eligible residents during the study period were invited to participate. The survey instrument was designed to collect a range of demographic and preference-based data. Participants were asked to provide information regarding their age, current year of residency training, and their preferred music genres. Crucially, the survey also explored the residents’ work habits related to music, specifically inquiring whether they typically worked with or without background music and their preferred music genre. The survey also collected information on spouse employment status, which was divided into two groups: physicians and non-physicians.
Statistical analysis was performed to assess the difference between groups within the collected data. The independent t-test was employed to analyse continuous data that demonstrated a normal distribution. For continuous data that did not meet the assumptions of normality, the non-parametric Kruskal-Wallis test was utilised. In all statistical analyses, a significance level (p-value) of 0.05 was established as the threshold for statistical significance, indicating a 5% risk of concluding a relationship exists when it does not. All participants have given informed consent before any data were collected.
III. RESULTS
A total of 125 residents participated in this study. Nineteen pathology anatomy residents, 33 urology resident and 73 ophthalmology residents were included. The descriptive statistic of age and sex are presented in Table 1. Marital status and ethnicity are presented in Appendix 1.
|
|
|
Pathology Anatomy (n = 19) |
Urology (n = 33) |
Ophthalmology (n = 73) |
p-value |
|
Age |
|
|
|
|
|
|
|
Mean ± SD |
33.16 ± 3.11 |
30.09 ± 2.11 |
30.51 ± 2.55 |
0.002* |
|
|
Median (Range) |
34.00 (29-39) |
30.00 (27-37) |
30.00 (26-36) |
|
|
Sex |
|
|
|
|
|
|
|
Male |
4 (21.1%) |
26 (79.8%) |
22 (30.1%) |
<0.01 |
|
|
Female |
15 (78.9%) |
7 (21.2%) |
51 (69.9%) |
|
*Kruskal Wallis Test
Table 1. Age, sex, ethnicity and marital status of the residents
In male resident population, distribution between married and not married is quite equal between specialty (Figure 1). In urology, married male residents is 58%, while it is 68% and 50% in ophthalmology and pathology, respectively. There is sharp difference in female urology resident compared to other specialties. There are only 14% female urology residents who is married, while in ophthalmology and pathology is 63% and 67%, respectively.

Figure 1. Marital status proportion in male (A) and female (B) residents

Figure 2. Proportion of married residents with physician spouse
In urology, 81% of residents also married to physicians, while it is only 55% in ophthalmology and 42% in pathology (Figure 2).
Most residents in urology (69.70%) and pathology (73.68%) reported that they were listening to musical background while working (Figure 3). While only 38.36% in ophthalmology that worked with musical background.

Figure 3. Comparison between residents working with musical background and those without
In those three specialties, most of the residents prefer pop music compared to others. A total of 48.48%, 52.63%, and 61.64% residents in urology, pathology and ophthalmology prefers pop music (Figure 4). Rock music was the 2nd most popular music among urology residents (21.21%), while it is classical music in pathology residents (26.32%).

Figure 4. Residents’ music genre preference (in percentage)
IV. DISCUSSION
This study explored the relationship between music genre preferences and medical specialty selections among residents at Padjadjaran University. There is a higher median age among pathology anatomy residents than among urology and ophthalmology residents, and there is a greater proportion of males in the urology department (Table 1). In spite of this, all residents from the three departments belong to the same generation (Juekiewicz, 2023). As residents in the same generation (generation Y), they are influenced by similar external influences, values, and ethical principles which influence their music genre preferences (Juekiewicz, 2023; Krumhansl, 2017).
Given that Indonesia is composed of multiple ethnic groups, and ethnicity could influence music genre preference, we found that the top three ethnic groups that reside in the three departments are somewhat similar, namely mixed ethnicity, Sundanese, and Javanese (Table 1). This percentage ranking differs from that of the Badan Pusat Statistik (BPS), which indicates that the top three groups by population are Java (40.22%), Sundanese (15.5%), and Batak (3.58%) (Badan Pusat Statistik [BPS], 2010).
Since music serves as a connection function between people, we evaluate the marital status of the residents (Bamford et al., 2024). In urology, 52% of residents are married, while in pathology and anatomy, 37% and 36% are married, respectively (Table 1). While females comprise only 21% of urology residents, the majority of them are unmarried (86%), which is compared to only 33% and 37% of female pathology anatomy and ophthalmology residents who are unmarried, respectively (Figure 1).
Eighty-one percent of urology residents are married to a physician compared to 55% of ophthalmology residents and 42% of pathology anatomy residents (Figure 2). Study by Dutta RR, et all showed that only 26.1% of physician married with physician (Dutta et al., 2024). However, the study did not compare the percentage of physicians who are married to other physicians in each specialty.
Compared with urology residents (69.7%) and pathology anatomy residents (73.68%), only 38.36% of ophthalmology residents listen to music while working (Figure 3).
Pop genre is the most preferred genre among three groups of residents, comprising 48% of residents in the urology and 61% of residents in the ophthalmology groups, as well as 52% of residents in the pathology anatomy groups (Figure 4). This finding is similar to a study by Krumhansl that the pop genre is the most preferred genre for individuals born between 1940 and 1999 (Krumhansl, 2017). However, the second most preferred genre among urology residents is rock (21%), while jazz (10.9%) and indie (10.9%) are the second most preferred genres in ophthalmology, and classical music (26%) is the second most preferred genre in pathology anatomy. The difference in genre music preference can also be observed in the third to last rank on the list (Figure 4).
The variation in secondary music genre preferences among specialties may be partially explained by psychological theories of personality, particularly the Five-Factor Model (FFM), which posits five broad domains of personality: openness, conscientiousness, extraversion, agreeableness, and neuroticism. Prior research has shown that individuals who prefer classical music tend to score high in openness and introversion—traits often linked to reflective and analytical disciplines such as pathology. In contrast, rock and pop fans tend to exhibit higher levels of extraversion and openness to experience, traits more commonly observed in high-intensity, procedurally driven fields like urology (Rentfrow & Gosling, 2003; Schäfer & Mehlhorn, 2017). However, in our study, most residents prefer pop music.
From a sociological perspective, medical specialties may be seen as “occupational subcultures” (Becker, 1963), each with distinct values, stress profiles, and interaction patterns. These subcultures attract individuals whose identities align with the implicit norms of the field (Light, 1979), potentially explaining the alignment between music preference and specialty. For example, the high-paced, team-intensive nature of urology might attract residents who identify with more energetic and expressive music like rock. Conversely, fields like pathology, which involve solitary analysis, may appeal to those who appreciate structured and introspective genres like classical music.
This study has several limitations that affect generalisability of the findings. While the study used a total sample of residents from three departments, the number of residents from each specialty varies, with 19 respondents from pathology anatomy, 33 respondents from urology, and 73 respondents from ophthalmology. In addition, the study’s sample was drawn exclusively from residents of one university.
Despite its limitations, this study presents several strengths that contribute to its value. The study explores a unique and interesting relationship between music genre preferences and medical specialty selection, particularly within the Indonesian cultural context. This area is relatively understudied and by focusing on medical residents, a specific population facing unique career pressures, the research addresses a relevant and understudied group. Furthermore, we acknowledgment of Indonesia’s diverse cultural influences, highlighting the potential impact of environment on both musical tastes and professional choices. We hope that this study will open avenues for further research and raising awareness about the potential influence of external factors like music on medical professionals.
V. CONCLUSION
This cross-sectional study explored the relationship between music genre preferences and medical specialty selections among residents at Padjadjaran University in Indonesia. While the study revealed variations in music preferences distribution across different specialties, pop being the most favored genre and different preference in second to last rank.
We found that there are differences in demographic distributions, particularly age and gender, among the resident groups, it is important to acknowledge the limitations of the study’s design. The use of a single-institution sample and the cross-sectional methodology limit the generalisability of the findings and preclude the establishment of causal relationships. Nevertheless, the study offers a preliminary investigation into the potential interplay between musical tastes and career choices within the medical field, raising intriguing questions for future research.
Further studies with larger and more diverse samples, are needed to expand upon these findings, and to explore the underlying mechanisms that might link music preferences to medical specialisation.
Notes on Contributors
ATS contributed to the conceptualisation, data curation, methodology, formal analysis, project administration, validation, investigation, funding acquisition, resources, visualisation, software, supervision, writing of the original draft, review and editing.
AK contributed to the methodology, formal analysis, resources, visualisation, software, supervision, writing of the original draft, review and editing.
AY contributed to the investigation, visualisation, software, supervision, writing of the original draft, review and editing.
Ethical Approval
This study was performed under the ethical approval from Hasan Sadikin Hospital Ethical Committee (Approval Number: DP.04.03/D.XXIV.16/14527/2024). This study is in line with the 1964 Declaration of Helsinki and existing ethical standards.
Data Availability
The data supporting this study are available upon reasonable request to Corresponding Author.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of Interest
The authors declare no relevant financial or non-financial competing interest from any party.
References
Andrews, C., Gardiner, K., Jain, T. K., Olomi, Y., & North, A. C. (2022). Culture, personal values, personality, uses of music, and musical taste. Psychology of Aesthetics, Creativity, and the Arts, 16(3), 468–486. https://doi.org/10.1037/aca0000318
Badan Pusat Statistik. (2010). Kewarganegaraan, suku bangsa, agama, dan bahasa sehari-hari penduduk Indonesia (Ch. 3, Komposisi penduduk, p. 9). Badan Pusat Statistik. https://www.bps.go.id/id/publication/2012/05/23/55eca38b7fe0830834605b35/kewarganegaraan-suku-bangsa-agama-dan-bahasa-sehari-hari-penduduk-indonesia.html
Bamford, J. S., Vigl, J., Hämäläinen, M., & Saarikallio, S. H. (2024). Love songs and serenades: A theoretical review of music and romantic relationships. Frontiers in Psychology, 15, 1302548. https://doi.org/10.3389/fpsyg.2024.1302548
Becker, H. S. (1963). Outsiders: Studies in the sociology of deviance. Free Press.
Dobrota, S., & Reić, E. I. (2014). The relationship between music preferences of different mode and tempo and personality traits – Implications for music pedagogy. Music Education Research, 17(2), 234–247. https://doi.org/10.1080/14613808.2014.933790
Dutta, R. R., Wu, A. T., Picton, B., Shah, S., Chernyak, M., Bauer, K., Solomon, S., Chang, J., Nguyen, B., Jiang, M., & Hurria, A. (2024). Physician marriage survey reveals sex and specialty differences in marital satisfaction factors. Scientific Reports, 14(1), 5159. https://doi.org/10.1038/s41598-024-55437-3
Jurkiewicz, C. L. (2023). Age diversity and generational ethics. In L. C. Becker & C. B. Becker (Eds.), Encyclopedia of ethics (pp. 54–62). Springer. https://doi.org/10.1007/978-3-030-22767-8
Knox, D., & MacDonald, R. (2016). Broadcasting personalities: The relationship between occupation and music preferences in the BBC radio programme Desert Island Discs. Psychology of Music, 45(5), 645–664. https://doi.org/10.1177/0305735616670497
Krumhansl, C. L. (2017). Listening niches across a century of popular music. Frontiers in Psychology, 8, 431. https://doi.org/10.3389/fpsyg.2017.00431
Light, D. W. (1979). Becoming psychiatrists: The professional transformation of self. W. W. Norton & Company.
Rentfrow, P. J., & Gosling, S. D. (2003). The do re mi’s of everyday life: The structure and personality correlates of music preferences. Journal of Personality and Social Psychology, 84(6), 1236–1256. https://doi.org/10.1037/0022-3514.84.6.1236
Schäfer, T., & Mehlhorn, C. (2017). Can personality traits predict musical style preferences? A meta-analysis. Personality and Individual Differences, 116, 265–273. https://doi.org/10.1016/j.paid.2017.04.061
Smaldino, P. E., Lukaszewski, A., von Rueden, C., & Gurven, M. (2019). Niche diversity can explain cross-cultural differences in personality structure. Nature Human Behaviour, 3, 1276–1283. https://doi.org/10.1038/s41562-019-0730-3
Triandis, H. C., & Suh, E. M. (2002). Cultural influences on personality. Annual Review of Psychology, 53, 133–160. https://doi.org/10.1146/annurev.psych.53.100901.135200
Upadhyay, D. K., Shukla, R., Tripathi, V. N., & Agrawal, M. (2017). Exploring the nature of music engagement and its relation to personality among young adults. International Journal of Adolescence and Youth, 22(4), 484–496. https://doi.org/10.1080/02673843.2016.1245150
Wang, Y., Qu, W., & Ge, Y. (2024). Relationship between personality and music preference: Psychometric adaptation of the music preference scales in a Chinese sample. Musicae Scientiae, 29(1), 109-130. https://doi.org/10.1177/10298649241287072
*Aaron Tigor Sihombing
Jl. Raya Jatinangor, Cikeruh, Kec. Jatinangor,
Kabupaten Sumedang, Jawa Barat 45363
+62 813-2132-9126
Email: aarontigor@gmail.com
Submitted: 11 February 2025
Accepted: 11 July 2025
Published online: 7 October, TAPS 2025, 10(4), 97-99
https://doi.org/10.29060/TAPS.2025-10-4/II3669
Suryanti Chan1, Hamzah Hamzah2 & Insan Sosiawan Tunru3
1Department of Medical Education, Faculty of Medicine, Universitas Dian Nuswantoro, Indonesia; 2Airlangga Teaching Hospital, Airlangga University, Indonesia; 3Faculty of Medicine, University Yarsi, Indonesia
I. INTRODUCTION
Medical education is a cornerstone of effective healthcare delivery, directly shaping professionals responsible for addressing the complex and evolving needs of patients, families, and communities. Over the last few decades, medical education has undergone significant transformations due to global trends that have influenced curricula structures, learning methodologies, and competency requirements for healthcare professionals. These shifts reflect broader societal, technological, and policy changes, necessitating adaptable and forward-thinking medical education systems.
One key driver of change is globalisation, fostering interconnected healthcare systems and necessitating curricula that emphasise global health perspectives, cultural competence, and cross-disciplinary collaboration.
Additionally, technological advancements, such as simulation-based learning, virtual reality (VR), augmented reality (AR), and telemedicine training, have revolutionised medical education, improving accessibility and enhancing learning experiences.
The increasing importance of accreditation and quality assurance frameworks ensures standardisation in medical education across regions, promoting transparency and continuous improvement (Bedoll et al., 2021). Simultaneously, the shift towards outcome-based education (OBE) prioritise competency-driven frameworks over traditional content-heavy curricula, aligning medical training with healthcare needs. Furthermore, cultural and contextual adaptations are crucial in tailoring curricula to regional healthcare priorities while maintaining global standards.
This paper examines how these international trends, globalisation, technological advancements, accreditation, outcome-based education, and cultural contextualisation, are shaping the future of medical education and influencing curricula to remain responsive to evolving healthcare demands.
II. APPROACH TO SYNTHESIS
Drawing on peer-reviewed articles, academic texts, and authoritative reports published over the past decade, this paper explores key international trends influencing medical education curricula. Sources were identified through a purposive review of major databases, such as PubMed, Scopus, and Web of Science, using keywords including “medical education curriculum,” “globalisation,” “technological change in education,” and “outcome-based education.” Selection was guided by relevance, conceptual contribution, and alignment with contemporary educational discourse. Through interpretive synthesis, the emerging themes were organised to highlight the evolving priorities and challenges in curriculum development across diverse global settings.
III. GLOBAL TRENDS SHAPING MEDICAL EDUCATION
Synthesising insights from the existing literature, several key themes emerge, including globalisation, technological advancement, accreditation and quality assurance, and the shift toward outcome-based education, each significantly shaping curriculum design in medical education.
A. Globalisation and Medical Education
Globalisation necessitates the integration of global health perspectives in medical curricula, enhancing students’ cultural competence, global awareness, and adaptability in diverse clinical settings. Imafuku et al. (2021) report that international electives and exposure to various healthcare systems foster a broader understanding of global health challenges. Rukadikar et al. (2022) emphasise embedding cultural competence longitudinally rather than as isolated modules. However, integrating global content can be hampered by linguistic, ethical, and logistical barriers, particularly in low-resource regions. There is also a risk of curricular homogenisation that overlooks local relevance. Initiatives such as the ASEAN Medical Schools Network attempt to address this tension by fostering regional collaboration while maintaining context-sensitive design. Ultimately, globalisation challenges medical educators to balance international standards with localised priorities, cultivating graduates who are both globally minded and locally responsive.
B. Technological Advancements
The digital transformation of medical education, catalysed by the COVID-19 pandemic, has reshaped how knowledge and clinical skills are imparted. Simulation-based learning, virtual patients, high-fidelity manikins, and telemedicine platforms offer realistic, risk-free environments for students to practise complex procedures (Castro et al., 2021). Virtual and augmented reality hold immense promise, especially in underserved areas where traditional clinical exposure is limited (Li et al., 2024). Nevertheless, adoption remains uneven. Barriers such as digital illiteracy, inadequate infrastructure, and resistance to change among faculty hinder optimal implementation. Furthermore, technological integration demands a pedagogical shift towards student-centred, self-directed learning models that not all institutions are prepared to adopt. Addressing these challenges requires systemic investment in digital infrastructure, faculty development, and curriculum redesign to fully harness the potential of educational technology.
C. Accreditation and Quality Assurance
Global accreditation standards, such as those set by the WFME, aim to enhance comparability and mobility of medical graduates by ensuring a baseline of quality and accountability (Bedoll et al., 2021). These frameworks advocate for continuous self-evaluation, peer review, and outcome monitoring. However, rigid adherence to international benchmarks may marginalise unique local needs and strain under-resourced institutions. For example, some Southeast Asian medical schools struggle to meet standards due to shortages in qualified faculty, simulation resources, or research infrastructure. Regional mechanisms like the ASEAN-QA (Asian University Network-Quality Assurance) Framework provide a more flexible model, supporting capacity-building and mutual recognition of quality. Moving forward, accreditation should not be seen solely as a compliance mechanism but as a catalyst for meaningful institutional improvement rooted in contextual realities.
D. Outcome-Based Education
OBE represents a fundamental paradigm shift, placing student competencies at the heart of curriculum design and assessment. Instead of focusing on the amount of content delivered, OBE emphasises the achievement of predefined clinical, ethical, and interpersonal outcomes. The model supports accountability and alignment between educational outcomes and healthcare needs. Ten Cate advocates for the use of Entrustable Professional Activities (EPAs) to operationalise OBE, offering a structured way to assess readiness for clinical practice. However, the practical implementation of OBE remains challenging. Many institutions lack robust tools for assessing soft skills, professional attitudes, and interprofessional collaboration. Furthermore, faculty may be unfamiliar with the principles of formative, feedback-oriented assessment that OBE requires. Successful implementation demands long-term commitment to faculty development, curriculum mapping, and resource allocation, as well as a cultural shift toward continuous quality improvement.
IV. CONCLUSION
The evolution of medical education is shaped by globalisation, technological advancements, accreditation, cultural adaptation, and outcome-based education. These trends emphasise the need for medical curricula that are adaptable, inclusive, and aligned with global healthcare challenges. Moving forward, medical education must remain dynamic and forward-thinking to prepare graduates for both current and future healthcare landscapes.
Notes on Contributors
Suryanti Chan (SC) contributed to the study design, data collection, and manuscript writing. She was responsible for analysing the findings and drafting the discussion.
Hamzah Hamzah (HH) contributed to the study design, literature review, and manuscript revision. He provided insights on the impact of international trends on medical education curriculum, particularly from the perspective of clinical training and healthcare service management in teaching hospitals.
Insan Sosiawan Tunru (IST) contributed to the study design, literature review, and manuscript revision. He provided insights on the impact of international trends on medical education curriculum, particularly from the perspective of accreditation regulation in Indonesia.
Ethical Approval
This manuscript is a literature review based on existing published studies and does not involve any original data collection or interaction with human participants.
Acknowledgement
Authors would like to express their deepest gratitude and appreciation to Prof. Ir Edi Noersasongko, M.Kom, Prof. Pulung Nurtantio Andono, S.T., M.Kom, Dr. Abdul Syukur, M.M, Dr. Hendriani Selina, Sp. A (K), MARS which has supported during this review.
Funding
This study did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Declaration of Interest
The authors declare that there are no conflicts of interest related to this study.
References
Bedoll, D., Van Zanten, M., & McKinley, D. (2021). Global trends in medical education accreditation. Human Resources for Health, 19(70), 1–15. https://doi.org/10.1186/s12960-021-00588-x
Castro, M. R. H., Calthorpe, L. M., Fogh, S. E., McAllister, S., Johnson, C. L., Isaacs, E. D., Ishizaki, A., Kozas, A., Lo, D., Rennke, S., Davis, J., & Chang, A. (2021). Lessons from learners: Adapting medical student education during and post COVID-19. Academic Medicine, 96(12), 1671–1679. https://doi.org/10.1097/ACM.0000000000004148
Imafuku, R., Saiki, T., Hayakawa, K., Sakashita, K., & Suzuki, Y. (2021). Rewarding journeys: Exploring medical students’ learning experiences in international electives. Medical Education Online, 26(1), 1913784. https://doi.org/10.1080/10872981.2021.1913784
Li, X., Elnagar, D., Song, G., & Ghannam, R. (2024). Advancing medical education using virtual and augmented reality in low- and middle-income countries: A systematic and critical review. Virtual Worlds, 3(3), 384–403. https://doi.org/10.3390/virtualworlds3030021
Rukadikar, C., Mali, S., Bajpai, R., Rukadikar, A., & Singh, A. K. (2022). A review on cultural competency in medical education. Journal of Family Medicine and Primary Care, 11(8), 4319–4329. https://doi.org/10.4103/jfmpc.jfmpc_2503_21
*Suryanti Chan
MD, MPH, MMed, PhD (Health Sciences), FIHFAA
Universitas Dian Nuswantoro,
Pendrikan Kidul Number 184,
Semarang, Central Java Province, Indonesia
(62)851-011-56248
Email: suryanti83@yahoo.com
Submitted: 11 January 2025
Accepted: 11 August 2025
Published online: 7 October, TAPS 2025, 10(4), 77-80
https://doi.org/10.29060/TAPS.2025-10-4/SC3818
Yassar Alamri
Department of Medicine, University of Otago, Christchurch, New Zealand
Abstract
Introduction: Response rates to surveys of medical students and junior doctors have not previously been explicitly examined. Reasons for the observed response rates have not been scrutinised. The aims of the present study were to establish an expected response rate to electronic survey among medical students and junior doctors, and to explore reasons behind non-response.
Methods: A follow-up online survey was sent to 93 medical students and junior doctors. The primary method for participants to complete the survey was via the Internet using a well-known and established survey tool. Descriptive and inferential statistics were used to assess response rates and reasons for non-response.
Results: Out of 93 invited medical students and junior doctors, 47 returned the follow-up survey (response rate = 50.5%). The main reasons for non-response were: there were too many surveys (74.4%), lack of time (25.5%), and the original survey being too long (10.6%).
Conclusion: We found a mediocre response rate (50.5%) to electronic surveys by medical students and junior doctors included in this study. Several factors that may impede response to surveys (survey-related, and participant-related) have been identified, and these may be specifically targeted to improve survey response rates.
Keywords: Medical Student, Survey, Response Rate, Research, Methodology
I. INTRODUCTION
Surveys offer an important method of collecting quantitative data from physicians and medical students on various aspects of medical and clinical research. The ease and convenience of online and web-based surveys (compared with telephone or face-to-face interviews) should theoretically enhance response rates. However, the ideal method of surveying the medical workforce (which would yield a high rate of and representative responses) is yet to be identified.
Physicians have traditionally been reported to have poor response rates to surveys in general. Studies that have specifically assessed response rates to surveys among physicians revealed overall rates of 35–50% (Cunningham et al., 2015). Response rates to surveys and reasons for non-response by medical students and junior doctors have seldom been specifically examined. Previous response rates to the National Physician Survey in Canada reported response rates of approximately 28–35% by medical students and junior doctors (Grava-Gubins & Scott, 2008), although these data are almost two decades old now.
Several reasons for non-response emerge from reviewing the pertinent literature; these can be divided into: survey-factors, and respondent-factors. Survey-factors include the length of the questionnaire (Grava-Gubins & Scott, 2008), perceived interest in and sensitivity of the surveyed topic (Cunningham et al., 2015), and the mode of survey delivery (i.e., electronic, telephone or face-to-face) (Grava-Gubins & Scott, 2008; Weaver et al., 2019). Several incentives have been instigated in order to improve response rates by addressing some of these survey-factors, including utilising electronic surveys that can be completed in more than one setting (at the participants’ convenience)(Weaver et al., 2019), monetary gifts or “educational credit” for participation (Grava-Gubins & Scott, 2008; Viera & Edwards, 2012), and employing internal “buy in” from a respected member of the intended sample (e.g., senior clinician or head of department) (Akl et al., 2011). Respondent-factors for non-response include lack of time, demographic differences, and the specialty of the respondent.
The aims of the present study were to establish an expected response rate to electronic survey among medical students and junior doctors, and to explore reasons behind non-response. No previous study has focused on medical students and junior doctors (i.e., junior medical workforce); therefore, addressing these issues would help fill several gaps in our knowledge.
II. METHODS
A. Study Setting
A previous study (Alamri et al, in press) invited all medical students at the University of Otago, and junior doctors at the Christchurch Hospital (both in Christchurch, New Zealand), to complete an electronic ‘index questionnaire’ on their research activities. The overall response rate of the original survey was 36% despite employing an online survey, several reminders and monetary gift vouchers.
B. Study Participants and Instrument
For the present study, eligible participants were medical student and junior doctor who had started the ‘index questionnaire’, but never completed it. The identified ‘non-responders’ were then invited to a secondary follow-up survey which was sent after the allotted time-period for the index questionnaire had lapsed (August–September 2018).
The follow-up survey was intentionally designed to be very brief, and based upon previous similar surveys (Cunningham et al., 2015). It only included four questions: participant age and sex, current career, and “what were the reasons for not completing [the index questionnaire]?”.
C. Statistical Analysis
Descriptive statistics (means ± standard deviations, and percentages) were used to analyse most of the data. Comparisons between medical students and junior doctors (two sub-populations with different responsibilities and time commitments) were conducted using Chi-square analyses for categorical values (e.g., sex, and entry to medical school), and Mann-Whitney U test for nonparametric continuous variables (e.g., age). Statistical significance was determined if type I error rate was < 5% (p-value < 0.05). All analyses were performed using the Statistical Package for Social Sciences software (SPSS Statistics®, version 22.0.0.0).
III. RESULTS
A. Study Participants
A total of 93 eligible participants were identified as potential participants. Following electronic invitation, 47 returned the follow-up survey (response rate: 47/93 = 50.5%). Two thirds (31/47; 66%) of the respondents were female. The median age was 23 years (range, 19–42). Most of the respondents (40/47, 85.1%) were medical students (see Table 1).
|
|
Medical students |
Junior doctors |
p value |
|
N |
40 |
7 |
|
|
Sex (% male, standard error) |
40% (0.08) |
22% (0.09) |
0.15 |
|
Age (mean, SD) |
21.2 ± 3.7 |
24.9 ± 5.5 |
0.01 |
|
Entry to medical school (% post-graduate) |
71.8% |
59.1% |
0.33 |
Table 1. Summary of participant data
B. Non-Response Survey Findings
Reasons for non-response varied among the participants. The most common reasons included: there were too many surveys (74.4%), lack of time (25.5%), the original survey was too long (10.6%), participant erroneously thought they had completed the survey (8.4%), and participant did not think they were eligible (2.1%). Of note, two of the participants (4.3%) responded unfavourably to the offer of the follow-up survey, finding it annoying and offensive.
IV. DISCUSSION
The response rate to the follow-up survey was 50.5% which was lower than anticipated. Non-responders to the index questionnaire were re-contacted to explore reasons behind the observed low response rate. The most common cited reasons were there were too many surveys requests (‘survey fatigue’), and lack of time. Just under 10% of participants had genuinely thought that they completed the original survey, which may indicate an underlying technical problem/lack of clarity. These reasons generally echo those voiced by physician specialists when asked about their response rates (Cunningham et al., 2015), although no studies have examined these reasons in medical students or junior doctors.
Only a handful of previous studies have specifically examined the rates of survey response by medical students and junior doctors. Canadian medical students had response rates of 30.8–31.2% to an electronic version of the Canadian National Physician Surveys in 2004 and 2007 (Grava-Gubins & Scott, 2008). From our experience over several studies in New Zealand, the average response rate from medical students seems to be around 30–35% (Alamri et al, in press). Response rates from junior doctors seem to be even lower, with 27.9–35.6% response rates in Canada (Grava-Gubins & Scott, 2008), and 24.9% in New Zealand (Alamri et al, in press). The range of response rates to surveys by junior doctors varies significantly—at least in part due to the fact that some of the surveys were compulsory to complete (thus, resulting in very high response rates).
Whilst a survey’s response rate ought not be the sole judge of the study’s validity (Cunningham et al., 2015), it is important to understand the reasons behind low survey response rates. We are unaware of any studies that have examined reasons for students’ survey non-response, or factors that would influence them. On the other hand, several randomised trials examined the effect of various factors on the response rates by physicians. Factors that increased response rates by physicians included: contact by regular mail (Akl et al., 2011) (although this finding was inconsistent among studies (Viera & Edwards, 2012), and the availability of the survey in several local languages (Grava-Gubins & Scott, 2008). Factors that worsened response rates included: offering continuing medical education credits for completing a survey (Viera & Edwards, 2012), and surveys on sensitive topics (Cunningham et al., 2015). Finally, factors that had no influence on response rates included: length of the survey (Akl et al., 2011), the day of invitation to the survey (Akl et al., 2011), and monetary compensation for participation (Akl et al., 2011).
V. CONCLUSION
Our findings generally reflect those reported in the literature of the response rates to research surveys by medical professionals; these seem to vary between 25 and 50% (usually at the lower end for junior doctors/medical students, and the higher end for specialists). Several factors that impede response to surveys (survey-related, and participant-related) have been identified, including the number of surveys sent to medical professionals, and the general lack of time.
The current study was limited by the relatively small number of participants, and by the fact that it originates from a single centre in New Zealand which may limit its generalisability. However, it provides a unique perspective by targeting survey non-responders (i.e., the population of interest), offers recent and updated data, and corroborates findings from previous studies in other settings/countries.
Finally, it is imperative to acknowledge that a high response rate may not necessarily be the panacea to the perfect survey study. How factors can be manipulated in order to yield higher response rates remains to be answered. One solution could be the implementation of an advisory body that provides guidance to researchers about how to design surveys, and regulates the number of survey invitations received by medical professionals in order to avoid ‘survey fatigue’.
Notes on Contributors
The sole author conceived the idea, collected and analysed the data and wrote the manuscript.
Ethical Approval
This study was approved by the University of Otago Human Ethics Committee (reference D18/207). All participants provided consent on the electronic survey form.
Data Availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request after completion of data publication as this remains a work in progress.
Acknowledgement
The authors would like to extend their gratitude to the Department of Psychological Medicine, University of Otago, Christchurch, for their financial assistance with participant compensation. The Department had no involvement in the study otherwise.
Funding
The author received financial assistances (NZ $1,500) from the Department of Psychological Medicine, University of Otago, Christchurch in the form of gift vouchers in order to reimburse participants in our study.
Declaration of Interest
The author declares no conflicts of interest, including financial, consultant, institutional and other relationships that might lead to bias or a conflict of interest.
References
Akl, E. A., Gaddam, S., Mustafa, R., Wilson, M. C., Symons, A., Grifasi, A., McGuigan, D., & Schünemann, H. J. (2011). The effects of tracking responses and the day of mailing on physician survey response rate: Three randomized trials. PLoS One, 6(2), e16942. https://doi.org/10.1371/journal.pone.0016942
Cunningham, C. T., Quan, H., Hemmelgarn, B., Noseworthy, T., Beck, C. A., Dixon, E., Samuel, S., Ghali, W. A., Sykes, L. L., & Jette, N. (2015). Exploring physician specialist response rates to web-based surveys. BMC Medical Research Methodology, 15, 32. https://doi.org/10.1186/s12874-015-0016-z
Grava-Gubins, I., & Scott, S. (2008). Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training. Canadian Family Physician, 54(10), 1424-1430. https://www.cfp.ca/content/54/10/1424.long
Viera, A. J., & Edwards, T. (2012). Does an offer for a free on-line continuing medical education (CME) activity increase physician survey response rate? A randomized trial. BMC Research Notes, 5, 129. https://doi.org/10.1186/1756-0500-5-129
Weaver, L., Beebe, T. J., & Rockwood, T. (2019). The impact of survey mode on the response rate in a survey of the factors that influence Minnesota physicians’ disclosure practices. BMC Medical Research Methodology, 19(1), 73. https://doi.org/10.1186/s12874-019-0719-7
*Yassar Alamri
Department of Medicine, Christchurch Hospital,
2 Riccarton Avenue, Christchurch 8011,
New Zealand
Email: yassar.alamri@nzbri.org
Announcements
- Best Reviewer Awards 2024
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2024.
Refer here for the list of recipients. - Most Accessed Article 2024
The Most Accessed Article of 2024 goes to Persons with Disabilities (PWD) as patient educators: Effects on medical student attitudes.
Congratulations, Dr Vivien Lee and co-authors! - Best Article Award 2024
The Best Article Award of 2024 goes to Achieving Competency for Year 1 Doctors in Singapore: Comparing Night Float or Traditional Call.
Congratulations, Dr Tan Mae Yue and co-authors! - Fourth Thematic Issue: Call for Submissions
The Asia Pacific Scholar is now calling for submissions for its Fourth Thematic Publication on “Developing a Holistic Healthcare Practitioner for a Sustainable Future”!
The Guest Editors for this Thematic Issue are A/Prof Marcus Henning and Adj A/Prof Mabel Yap. For more information on paper submissions, check out here! - Best Reviewer Awards 2023
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2023.
Refer here for the list of recipients. - Most Accessed Article 2023
The Most Accessed Article of 2023 goes to Small, sustainable, steps to success as a scholar in Health Professions Education – Micro (macro and meta) matters.
Congratulations, A/Prof Goh Poh-Sun & Dr Elisabeth Schlegel! - Best Article Award 2023
The Best Article Award of 2023 goes to Increasing the value of Community-Based Education through Interprofessional Education.
Congratulations, Dr Tri Nur Kristina and co-authors! - Volume 9 Number 1 of TAPS is out now! Click on the Current Issue to view our digital edition.

- Best Reviewer Awards 2022
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2022.
Refer here for the list of recipients. - Most Accessed Article 2022
The Most Accessed Article of 2022 goes to An urgent need to teach complexity science to health science students.
Congratulations, Dr Bhuvan KC and Dr Ravi Shankar. - Best Article Award 2022
The Best Article Award of 2022 goes to From clinician to educator: A scoping review of professional identity and the influence of impostor phenomenon.
Congratulations, Ms Freeman and co-authors. - Volume 8 Number 3 of TAPS is out now! Click on the Current Issue to view our digital edition.

- Best Reviewer Awards 2021
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2021.
Refer here for the list of recipients. - Most Accessed Article 2021
The Most Accessed Article of 2021 goes to Professional identity formation-oriented mentoring technique as a method to improve self-regulated learning: A mixed-method study.
Congratulations, Assoc/Prof Matsuyama and co-authors. - Best Reviewer Awards 2020
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2020.
Refer here for the list of recipients. - Most Accessed Article 2020
The Most Accessed Article of 2020 goes to Inter-related issues that impact motivation in biomedical sciences graduate education. Congratulations, Dr Chen Zhi Xiong and co-authors.









