Understanding the factors affecting duration in answering MCQ examination: The students’ perspective
Submitted: 6 April 2024
Accepted: 10 December 2024
Published online: 1 April, TAPS 2025, 10(2)
Chatchai Kreepala1, Srunwas Thongsombat2, Krittanont Wattanavaekin3, Taechasit Danjittrong4, Nattawut Keeratibharat5 & Thitikorn Juntararuangtong1
1School of Internal Medicine, Institute of Medicine, Suranaree University of Technology, Thailand; 2Department of Orthopedics, Faculty of Medicine, Prince of Songkla University, Thailand; 3Department of Surgery, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Thailand; 4Department of Anesthesiology, Chulabhorn Hospital, Thailand; 5School of Surgery, Institute of Medicine, Suranaree University of Technology, Thailand
Abstract
Introduction: Factors affecting decision-making duration in MCQs can enhance assessment effectiveness, ensuring they accurately measure the intended objectives and address issues related to incomplete exams due to time constraints. The authors aimed to explore the aspects of medical student’s perspective regarding the factors influencing their decision making on MCQ assessments.
Methods: A mixed-methods explanatory sequential design was utilised. Initial surveys were conducted using percentages, mean and non-parametric analysis obtained via online questionnaires from the sample group: all 2nd – 5th year medical students from SUT, Thailand. The validity of the questionnaires was verified by three independent reviewers (IOC=0.89). This was followed by semi-structured group interviews to explore student’s perspective on the factors affecting their decision. Qualitative analysis was conducted to explore detailed information until data saturation was achieved.
Results: Data from the quantitative analysis identified four factors that students believe affect the duration of the exam: the total word count of each question, test difficulty, and images in tests. Meanwhile, the qualitative analysis provided additional insights on factors such as the examination atmosphere affecting their decisions.
Conclusion: This report indicated that data acquired from a comprehensive reading question should be distinguished from those requiring decisive reading. Apart from text length, question taxonomy-such as recall or application- and questions with given images and tables should be considered as factors determining time allocation for an MCQ. Future research based on these results should aim to develop a mathematical formula to calculate exam duration, accounting for question difficulty and length.
Keywords: MCQ, Medical Assessment, Medical Education, Testing Time Estimation, Qualitative Research, Students’ Perspective
Announcements
- Best Reviewer Awards 2024
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2024.
Refer here for the list of recipients. - Most Accessed Article 2024
The Most Accessed Article of 2024 goes to Persons with Disabilities (PWD) as patient educators: Effects on medical student attitudes.
Congratulations, Dr Vivien Lee and co-authors! - Best Article Award 2024
The Best Article Award of 2024 goes to Achieving Competency for Year 1 Doctors in Singapore: Comparing Night Float or Traditional Call.
Congratulations, Dr Tan Mae Yue and co-authors! - Fourth Thematic Issue: Call for Submissions
The Asia Pacific Scholar is now calling for submissions for its Fourth Thematic Publication on “Developing a Holistic Healthcare Practitioner for a Sustainable Future”!
The Guest Editors for this Thematic Issue are A/Prof Marcus Henning and Adj A/Prof Mabel Yap. For more information on paper submissions, check out here! - Best Reviewer Awards 2023
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2023.
Refer here for the list of recipients. - Most Accessed Article 2023
The Most Accessed Article of 2023 goes to Small, sustainable, steps to success as a scholar in Health Professions Education – Micro (macro and meta) matters.
Congratulations, A/Prof Goh Poh-Sun & Dr Elisabeth Schlegel! - Best Article Award 2023
The Best Article Award of 2023 goes to Increasing the value of Community-Based Education through Interprofessional Education.
Congratulations, Dr Tri Nur Kristina and co-authors! - Volume 9 Number 1 of TAPS is out now! Click on the Current Issue to view our digital edition.
- Best Reviewer Awards 2022
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2022.
Refer here for the list of recipients. - Most Accessed Article 2022
The Most Accessed Article of 2022 goes to An urgent need to teach complexity science to health science students.
Congratulations, Dr Bhuvan KC and Dr Ravi Shankar. - Best Article Award 2022
The Best Article Award of 2022 goes to From clinician to educator: A scoping review of professional identity and the influence of impostor phenomenon.
Congratulations, Ms Freeman and co-authors. - Volume 8 Number 3 of TAPS is out now! Click on the Current Issue to view our digital edition.
- Best Reviewer Awards 2021
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2021.
Refer here for the list of recipients. - Most Accessed Article 2021
The Most Accessed Article of 2021 goes to Professional identity formation-oriented mentoring technique as a method to improve self-regulated learning: A mixed-method study.
Congratulations, Assoc/Prof Matsuyama and co-authors. - Best Reviewer Awards 2020
TAPS would like to express gratitude and thanks to an extraordinary group of reviewers who are awarded the Best Reviewer Awards for 2020.
Refer here for the list of recipients. - Most Accessed Article 2020
The Most Accessed Article of 2020 goes to Inter-related issues that impact motivation in biomedical sciences graduate education. Congratulations, Dr Chen Zhi Xiong and co-authors.