{"id":461,"date":"2020-02-12T13:18:59","date_gmt":"2020-02-12T05:18:59","guid":{"rendered":"https:\/\/medicine.nus.edu.sg\/taps\/?post_type=issues&#038;p=461"},"modified":"2022-04-25T17:21:27","modified_gmt":"2022-04-25T09:21:27","slug":"determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review","status":"publish","type":"issues","link":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/","title":{"rendered":"Determinants of clarification research purpose in medical education research: A systematic review"},"content":{"rendered":"<p style=\"text-align: justify\">Published online: 2 May, TAPS 2017, 2(2), 8-17<br \/>\r\nDOI:<a href=\"https:\/\/doi.org\/10.29060\/TAPS.2017-2-2\/OA1004\"> https:\/\/doi.org\/10.29060\/TAPS.2017-2-2\/OA1004<\/a><\/p>\r\n<p style=\"text-align: justify\">Wee Shiong Lim<sup>1,2<\/sup>, Kar Mun Tham<sup>3<\/sup>, Fadzli Baharom Adzahar, Han Yee Neo<sup>4<\/sup>, Wei Chin Wong<sup>1<span>\u00a0<\/span><\/sup>&amp; Charlotte Ringsted<sup>5<\/sup><\/p>\r\n<p style=\"text-align: justify\"><em><sup>1<\/sup><\/em><em>Department of Geriatric Medicine, Tan Tock Seng Hospital, Singapore;<span>\u00a0<\/span><sup>2<\/sup>Health Outcomes and Medical Education Research, National Healthcare Group, Singapore;<span>\u00a0<\/span><sup>3<\/sup>Yong Loo Lin School of Medicine, National University of Singapore, Singapore;<span>\u00a0<\/span><sup>4<\/sup>Depart<\/em>m<em>ent of Palliative Medicine, Tan Tock Seng Hospital, Singapore;<span>\u00a0<\/span><sup>5<\/sup>Centre for Health Science Education, Faculty of Health, Aarhus University, Denmark<\/em><\/p>\r\n<p style=\"text-align: center\"><strong>Abstract<\/strong><\/p>\r\n<p style=\"text-align: justify\"><strong>Background<\/strong>: Medical education research should aspire to illuminate the field beyond description (\u201cWhat was done?\u201d) and justification (\u201cDid it work?\u201d) research purposes to clarification studies that address \u201cWhy or how did it work?\u201d questions. We aim to determine the frequency of research purpose in both experimental and non-experimental studies, and ascertain the predictors of clarification purpose among medical education studies presented at the 2012 Asia Pacific Medical Education Conference (APMEC).<\/p>\r\n<p style=\"text-align: justify\"><strong>Methods:<span>\u00a0<\/span><\/strong>We conducted a systematic review of all eligible original research abstracts from APMEC 2012. Abstracts were classified as descriptive, justification or clarification using the framework of Cook 2008. We collected data on research approach (Ringsted et al., 2011), Kirkpatrick\u2019s learner outcomes, statement of study aims, presentation category, study topic, professional group, and number of institutions involved. Significant variables from bivariate analysis were included in logistic regression analyses to ascertain the determinants of clarification studies.<\/p>\r\n<p style=\"text-align: justify\"><strong>Results:<\/strong><span>\u00a0<\/span>Our final sample comprised 186 abstracts. Description purpose was the most common (65.6%), followed by justification (21.5%) and clarification (12.9%). Clarification studies were more common in non-experimental than experimental studies (18.3% vs 7.5%). In multivariate analyses, the presence of a clear study aim (OR: 5.33, 95% CI 1.17-24.38) and non-descriptive research approach (OR: 4.70, 95% CI 1.50-14.71) but not higher Kirkpatrick\u2019s outcome levels predicted clarification studies.<\/p>\r\n<p style=\"text-align: justify\"><strong>Conclusion:<\/strong><span>\u00a0<\/span>Only one-eighth of studies have a clarification research purpose. A clear study aim and non-descriptive research approach each confers a five-fold greater likelihood of a clarification purpose, and are potentially remediable areas to advance medical education research in the Asia-Pacific.<\/p>\r\n<p style=\"text-align: justify\"><strong>Keywords:\u00a0\u00a0\u00a0\u00a0\u00a0<span>\u00a0<\/span><\/strong><em>Research Purpose; Research Approach; Medical Education Research; Asia-Pacific<\/em><\/p>\r\n<p style=\"text-align: center\"><strong>Practice Highlights<\/strong><\/p>\r\n<ul class=\"ul-inner-format\">\r\n\t<li style=\"text-align: justify\">The hallmark of clarification research is the presence of a conceptual framework or theory that can be affirmed or refuted by the study results.<\/li>\r\n\t<li style=\"text-align: justify\">We should aspire towards clarification studies that address \u201cWhy or how did it work?\u201d questions.<\/li>\r\n\t<li style=\"text-align: justify\">Only one-eighth of studies have a clarification research purpose.<\/li>\r\n\t<li style=\"text-align: justify\">A clear study aim and non-descriptive research approach are potentially remediable areas to promote clarification studies.<\/li>\r\n<\/ul>\r\n<p style=\"text-align: center\"><strong>I. INTRODUCTION<\/strong><\/p>\r\n<p style=\"text-align: justify\">There is much debate about how to ensure that medical education research is not perceived as the poor relation of \u00a0Biomedical research (Shea, Arnold, &amp; Mann, 2004; Baernstein, Liss, Carney, &amp; Elmore, 2007; Todres, Stephenson, &amp; Jones, 2007).Some have proposed that if medical education were to fulfil its research potential and enjoy academic legitimacy, the discipline must develop a clearer sense of purpose and more rigorously follow the scientific line of enquiry characterized by a cycle of observation; formulation of a model or hypothesis to explain the results; prediction based on the model or hypothesis; and testing of the hypothesis (Cook, Bordage, &amp; Schmidt, 2008a; Bordage, 2009). In particular, medical educators often focus on the first step (observation) and the last step (testing), but omit the intermediate steps (model formulation or theory building, and prediction), and perhaps more importantly, fail to maintain the cycle by building upon previous results. Some authorities attribute this lack of a conceptual framework as a major reason for the paucity of impactful research questions that can illuminate and magnify the body of knowledge to advance the field of medical education (Albert, Hodges, &amp; Regehr, 2007; Cook et al., 2008b; Eva &amp; Lingard, 2008).<\/p>\r\n<p style=\"text-align: justify\">Conceptual frameworks represent ways of thinking about an idea, problem, or phenomenon by relating to theories, models, evidence-based best practices or hypotheses (Rees &amp; Monrouxe, 2010; Gibbs, Durning, &amp; Van der Vleuten, 2011). The framework assists in formulating the research question, choosing an appropriate study design, and determining appropriate outcomes to answer the research question. Situating the research question within a conceptual framework elevates and transforms the research purpose from a study which is focused on local issues, into a clarification study of general interest by engendering generalizable knowledge which can be transferable to new settings and future research (Bordage, 2009; Bunniss &amp; Kelly, 2010). Conceptual frameworks are also essential in interpreting the results. Their inter-dependent relationship is underscored by the fact that results are interpreted in light of the existing theories and conversely, existing boundaries of the theoretical framework may limit interpretation of the findings (Wong, 2016). For instance, in the field of observation-based assessments, there is a gradual theoretical shift from a more psychometric (based on large numbers of random elements) to a more expert judgement (based on fewer observation of well-informed opinions) framework (Hodges, 2013)<\/p>\r\n<p style=\"text-align: justify\"><em>A. Cook\u2019s Framework of Research Purpose<\/em><\/p>\r\n<p style=\"text-align: justify\">To better delineate this problem, Cook et al. (2008a) proposed a framework for classifying the purposes of research, namely description, justification and clarification.<span>\u00a0<\/span><em>Description studies<\/em><span>\u00a0<\/span>focus on the first step in the scientific method (observation) by addressing the question: \u201cWhat was done?\u201d<span>\u00a0<\/span><em>Justification studies<\/em><span>\u00a0<\/span>focus on the last step in the scientific method (testing) by asking: \u201cDid it work?\u201d However, without prior model formulation and prediction, the results may have limited application to future research or practice. In contrast,<span>\u00a0<\/span><em>clarification studies<\/em><span>\u00a0<\/span>seek to answer the question: \u201cWhy or how did it work?\u201d The hallmark of clarification research is the presence of a conceptual framework that can be affirmed or refuted by the study results (Cook et al., 2008a; Ringsted, Hodges, &amp; Scherpbier, 2011). Such research is often performed using classic experiments, but non-experimental methods such as correlation research, comparisons among naturally occurring groups, and qualitative research, are also applicable (Shea et al., 2004; Cook et al., 2008a).<\/p>\r\n<p style=\"text-align: justify\">Applying this framework in a systematic survey of 850 experimental and non-experimental studies on problem-based learning, Schmidt (2005) reported a paucity of clarification studies (7%) vis-\u00e0-vis description (64%) and justification (29%) studies. More recently, Garc\u00eda-Dur\u00e1n et al. (2011) reported the predominance of description studies (92.8%) with very few justification (6.8%) studies and just one (0.4%) clarification study among research presentations at a medical education meeting in Mexico. These results are consistent with the seminal study of 105 articles describing education experiments in 6 major journals by Cook et al. (2008a), which noted that clarification studies were uncommon (12%) relative to justification (72%) and description (16%) studies. In this study, inter-rater agreement for these classifications was only moderate at 0.48, with disagreements largely occurring in the classification of less clear-cut single-group pre-test\/post-test studies; this discrepancy has since been clarified in the revised definitions.<\/p>\r\n<p style=\"text-align: justify\"><em>B. Gaps in Current Knowledge<\/em><\/p>\r\n<p style=\"text-align: justify\">Cook et al. (2008a) proposed expanding the use of their framework beyond the limited genre of experimental studies to incorporate non-experimental study designs. This input is sorely needed, as studies with a purely descriptive design (which may not qualify as research by some authorities) historically constituted a significant proportion of the literature in medical education (Reed et al., 2008; Garc\u00eda-Dur\u00e1n et al., 2011). There is a unifying call for the use of stronger study designs in the field beyond cross-sectional descriptive approaches to enhance the quality of medical education research (Gruppen, 2007; Colliver &amp; McGaghie, 2008).<\/p>\r\n<p style=\"text-align: justify\">The opportunity to extend the study of research purpose beyond experimental studies, was afforded by the research compass framework described by Ringsted et al. (2011). Core to the model is the conceptual framework, which is central to any research approach taken. The compass depicts four main quadrants of research approaches in the conduct of medical education research: (1) Explorative studies, aimed at modelling by seeking to identify and explain elements of phenomena and their relationships; (2) Experimental studies, with the main aim of justification to define appropriate interventions and outcomes; (3) Observational studies, aimed at predicting outcomes by the study of natural or static groups of people; and (4) Translational studies, which focus on implementing knowledge and findings from research in complex real-life settings.<\/p>\r\n<p style=\"text-align: justify\">Furthermore, predictors of a clarification research purpose in medical education scholarship have hitherto not been studied. Factors that are associated with better quality of medical education research include number of institutions studied (Reed et al., 2007; Reed et al., 2008), outcomes based on the widely-used hierarchy of Kirkpatrick (1967), and the presence of a clear statement of study intent (Cook et al., 2008b). However, the association between these factors with research purpose has not been previously examined.<\/p>\r\n<p style=\"text-align: justify\"><em>C. Aims and hypothesis<\/em><\/p>\r\n<p style=\"text-align: justify\">In recent years, there is a surge of interest in research scholarship in medical education in the Asia-Pacific region. Concomitantly, regional forums such as the Asia-Pacific Medical Education Conference (APMEC) have emerged for the sharing of medical education research, along with ongoing discussions about how to propel the field forwards in conducting meaningful research that can inform educational practice (Gwee, Samarasekera, &amp; Chong, 2012). Determining the prevalence of research purpose of medical education studies from the Asia-Pacific region would be of immediate relevance in ascertaining whether there is a similar lack of clarification studies and research approaches beyond descriptive study designs.<\/p>\r\n<p style=\"text-align: justify\">Building upon the earlier work of Cook et al. (2008a) in experimental studies, we developed an empirical operational model that combined the frameworks of Cook and Ringsted to broaden the evaluation of research purpose to include non-experimental studies. The objectives of our study are: (1) to determine the frequency of research purpose in both experimental and non-experimental studies, and (2) to ascertain the predictors of a clarification research purpose among original research abstracts presented at APMEC 2012. In light of the findings in earlier studies of the relative paucity of clarification studies (Schmidt 2005; Cook et al., 2008a; Garc\u00eda-Dur\u00e1n et al., 2011), we hypothesize that the proportion of clarification studies would likewise be comparatively lower.<\/p>\r\n<p style=\"text-align: center\"><strong>II. METHODS<\/strong><\/p>\r\n<p style=\"text-align: justify\"><em>A. Study setting<\/em><\/p>\r\n<p style=\"text-align: justify\">This review drew from research abstracts submitted to APMEC 2012. This study is part of a larger piece of work that aims to contribute to the research agenda in the Asia-Pacific region by determining the trends in research purpose and approach in the last 5 years (2008 to 2012). The APMEC is an established regional conference held in Singapore that serves as an accessible \u201cclearinghouse\u201d providing a timely and comprehensive snapshot of research in the Asia Pacific region. The theme for the 9<sup>th<\/sup><span>\u00a0<\/span>APMEC in 2012 was \u201cTowards transformative education for healthcare professionals in the 21<sup>st<\/sup><span>\u00a0<\/span>century \u2013 nurturing lifelong habits of mind, behaviour and action.\u201d The National Healthcare Group Institutional Review Board deemed this study exempt from review.<\/p>\r\n<p style=\"text-align: justify\"><em>B. Study eligibility<\/em><\/p>\r\n<p style=\"text-align: justify\">All original research abstracts from APMEC 2012 were considered. Original research was defined as an educational intervention or trial; implementation of evidence based practice or guidelines; curriculum evaluation with subjective or objective outcomes; evaluation of an educational instrument or tool; qualitative research; and systematic reviews. We excluded abstracts from plenary lectures, workshops, special interest group meetings and discussions. Among 210 eligible abstracts, we excluded 24 that were not original research, thus yielding a final sample of 186 abstracts.<\/p>\r\n<p style=\"text-align: justify\"><strong>\u00a0C.<span>\u00a0<\/span><\/strong><em>Data extraction<\/em><\/p>\r\n<p style=\"text-align: justify\">We performed a pilot study using randomly selected abstracts from APMEC 2011 conference in order to fine-tune definitions of study variables and to refine the data collection form. Four reviewers were involved in data collection. After training and harmonization in the pilot phase, the four raters achieved good to excellent agreement in the coding (overall percentage agreement: 80-87%; ACI-statistic: 0.73 \u2013 0.82) (Gwet, 1991). For the study proper, each abstract was rated independently and in duplicate. Disagreements were resolved by discussion, and if no consensus was reached, via adjudication by a third independent reviewer.<\/p>\r\n<p style=\"text-align: justify\"><em>D. Data collection<\/em><\/p>\r\n<p style=\"text-align: justify\"><em>1) Study design<\/em><\/p>\r\n<p style=\"text-align: justify\">We classified abstracts into 2 broad categories based upon the \u201cresearch compass\u201d framework proposed by Ringsted et al. (2011): (1) Experimental, defined as any study in which researchers manipulated a variable (also known as the treatment, intervention or independent variable) to evaluate its impact on other (dependent) variables, including evaluation studies with experimental designs (Fraenkel &amp; Wallen, 2003); and (2) Non-experimental, defined as all other studies that do not meet criteria for (1). Studies using mixed methods (for instance, an experimental design with a qualitative component) were classified according to the methodology that was deemed to be predominant.<\/p>\r\n<p style=\"text-align: justify\">Experimental studies were further sub-classified as experimental, quasi-experimental or pre-experimental according to established hierarchies of research designs (Creswell, 2013). We defined experimental studies by the presence of randomization; examples included factorial design, crossover design and randomized controlled trials. In contrast, for quasi-experimental studies, experimental and control groups were selected without random assignment of participants (Colliver &amp; McGaghie, 2008). Pre-experimental studies, namely single group pre-post and post-only designs, did not have a control group for comparison.<\/p>\r\n<p style=\"text-align: justify\">Non-experimental studies were further sub-classified as descriptive, qualitative, psychometric, observational (comprising associational, case-control and cohort studies), and translational. Descriptive studies typically provide descriptions of phenomena, new initiatives or activities, such as curriculum design, instructional methods, assessment formats, and evaluation strategies (Ringsted, Hodges, &amp; Scherpbier, 2011). Because pure descriptive study designs may not strictly qualify as research by some authorities, they are ranked by default as lowest in the hierarchy of study designs (Crites et al., 2014). Hence, when two study designs were identified within the same study with one being descriptive, we coded based upon the \u201chigher\u201d non-descriptive study design.<\/p>\r\n<p style=\"text-align: justify\"><em>2) Research purpose<\/em><\/p>\r\n<p style=\"text-align: justify\">Research purpose is classified as description, justification or clarification based upon modified definitions of the Cook framework (Table 1). We further sub-classified clarification studies into whether they relate to theory, model\/evidence-based practices, or hypothesis. Because the original definitions pertain only to experimental studies, several modifications were necessary in order to accommodate non-experimental studies in the integrated frameworks of Cook and Ringsted (Table 2). In the process, we were mindful to adhere to the original spirit of the definitions as far as possible. For instance, even though the original definition of justification studies merited a comparison group, we waived this requirement for good quality psychometric studies for which we deemed that there was sufficient rigor in the measures of validity and reliability to answer the question \u201cDoes this assessment tool work?\u201d This was motivated by the intention to not \u201cpenalize\u201d these studies and spuriously inflate the proportion of description studies in this category. Many validation studies of assessment tools often involve a single group design to determine whether a tool works via implicit comparison with an unknown \u2018good enough\u2019 criterion. The dominance of the psychometric views on assessment would also mean that many assessment studies are unlikely to have included an explicit statement of the underlying theoretical (Classical Test Theory, G-theory or Item Response Theory) framework.<\/p>\r\n<p style=\"text-align: justify\">Similarly, prompted by the observation that certain categories of approaches would be incongruent with a justification design, such as qualitative and observational studies, we delinked where appropriate the hierarchy of purpose from description to justification. Thus, a well-conducted observational study underpinned by a conceptual framework that explains the relationship between independent and dependent variables, would still qualify as a clarification study. Lastly, in response to difficulties encountered in coding during the pilot phase, we further modified the definition of clarification studies to specify the presence of a conceptual framework that fulfilled 3 crucial elements: 1) A theory, model, or hypothesis that asks \u201cWhy or how does it work?\u201d 2) Transferability to new settings and future research; and 3) Confirmed or refuted by the results and\/or conclusions of the study.<\/p>\r\n<div class=\"table-responsive\">\r\n<table class=\"table table-bordered\">\r\n<tbody>\r\n<tr>\r\n<td><strong>A) Description<\/strong><\/td>\r\n<td>Describes what was done or presents a new conceptual model. Asks: \u201cWhat was done?\u201d There is no comparison group. May be a description without assessment of outcomes, or a \u201csingle-shot case study\u201d (single-group, post-test only experiment).<\/td>\r\n<\/tr>\r\n<tr>\r\n<td><strong>B) Justification<\/strong><\/td>\r\n<td>Makes comparison with another intervention with intent of showing that 1 intervention is better than (or as good as) another. Asks: \u201cDid it work?\u201d (Did the intervention achieve the intended outcome?). Any experimental study with a control group or single-group with pre-post intervention assessment would qualify. Good quality psychometric studies with measures of validity and reliability are exempt from the need for a comparison group, since justification that the tool \u201cworks\u201d typically does not involve a comparison group in these studies. Justification studies generally lack a conceptual framework or model that can be confirmed or refuted based on results of the study.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td><strong>C) Clarification<\/strong><\/td>\r\n<td>Clarifies the processes that underlie observed effects. Asks: \u201cWhy or how did it work?\u201d Often a controlled experiment, but could also use a case\u2013control, cohort or cross-sectional research design. Much qualitative research also falls into this category. Its hallmark is the presence of a conceptual framework that can be transferable to new settings and future research, and which can be confirmed or refuted by the results and\/or conclusions of the study. Further sub-classified into whether the conceptual framework pertains to a theory, model\/evidence-based practice, or hypothesis.<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p style=\"text-align: center\">Table 1: Definitions of research purposes (modified from Cook et al.<sup>5<\/sup>)<\/p>\r\n<div class=\"table-responsive\">\r\n<table class=\"table table-bordered\">\r\n<tbody>\r\n<tr>\r\n<td width=\"187\"><strong>Study Design*<\/strong><\/td>\r\n<td width=\"96\"><strong>Descriptive<\/strong><\/td>\r\n<td width=\"144\"><strong>Justification<\/strong><\/td>\r\n<td width=\"120\"><strong>Clarification<\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\"><strong>(I) Experimental<\/strong><\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Experimental<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Quasi-experimental<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6 (no randomization)<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Pre-experimental<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6 (pre-post only)<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\"><strong>(II) Non-experimental<\/strong><\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\"><strong><em>(1) Explorative<\/em><\/strong><\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Descriptive<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">X<\/td>\r\n<td width=\"120\">+\/-<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Qualitative<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">X<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Psychometric<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6 (validity, reliability)<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\"><strong><em>(2) Observation<\/em><\/strong><\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Associative<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">X<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Case control<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">X<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Cohort<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">X<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\"><strong><em>(3) Translational<\/em><\/strong><\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Knowledge creation<\/td>\r\n<td width=\"96\"><\/td>\r\n<td width=\"144\"><\/td>\r\n<td width=\"120\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">Narrative<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">+\/-<\/td>\r\n<td width=\"120\">X<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">Quantitative review<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6<\/td>\r\n<td width=\"120\">+\/-<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">Realist review<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Implementation<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"187\">\u2013 Efficiency<\/td>\r\n<td width=\"96\">\u00d6<\/td>\r\n<td width=\"144\">\u00d6<\/td>\r\n<td width=\"120\">\u00d6<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p style=\"text-align: center\">Table 2: Conceptual framework for possible classifications of research purpose when analyzed by research approach<br \/>\r\n*Modified from: Ringsted, C., Hodges, B., &amp; Scherpbier, A. (2011).<span>\u00a0<\/span><em>Medical Teacher<\/em>,\u00a0<em>33<\/em>(9), 695-709.<\/p>\r\n<p style=\"text-align: justify\"><em>\u00a0<\/em><em>3) Other variables<\/em><\/p>\r\n<p style=\"text-align: justify\">We extracted data on other variables which may affect the quality of medical education research. These included presentation category, topic of medical education addressed, professional group being studied, country of the study population, number of institutions involved, Kirkpatrick\u2019s learner outcomes (if applicable), and statement of study intent. We measured learner outcomes on 4 levels based upon Kirkpatrick\u2019s expanded outcomes typology, namely learner reactions (level 1), modification of attitudes\/perceptions (level 2a), modification of knowledge\/skills (level 2b), behavioural change (level 3), change in organizational practice (level 4a) and benefits to patients or healthcare outcome (level 4b) (Kirkpatrick, 1967; Reeves, Boet, Zierler, &amp; Kitto, 2015). If a study reported more than one outcome, the rating for the highest-level outcome was recorded, regardless of whether this was a primary or secondary outcome. Although the validity of `hierarchical application of Kirkpatrick\u2019s levels as a standard critical appraisal tool has been questioned, it still remains widely used in assessing the impact of interventions in medical education (Yardley &amp; Donan, 2012). The research question is arguably the most important part of any scholarly activity and is framed as a statement of study intent often in the form of a purpose, objective, goal, aim or hypothesis (Cook et al., 2008b). We therefore collected data on whether there is an explicit statement of study intent, and if present, its quality as judged by correct location in the aims section; representation of study goals as opposed to mere stating of educational objectives; and completeness of information (i.e. whether any important objective was omitted).<\/p>\r\n<p style=\"text-align: justify\"><em>E. Data Analysis<\/em><\/p>\r\n<p style=\"text-align: justify\">Results were summarized using descriptive statistics. Preplanned subgroup analyses were conducted with Chi-square test or Fischer\u2019s exact test using research purpose (description, justification or clarification) as the dependent variable. Significant variables from bivariate analysis (P&lt;.10) were included in logistic regression analysis to ascertain which of these factors were associated with a clarification study purpose. All analyses were performed using SPSS for Windows version 17.0 (SPSS Inc, Chicago, Illinois, USA). Statistical tests were two-tailed and conducted at 5% level of significance.<\/p>\r\n<p style=\"text-align: center\"><strong>III. RESULTS<\/strong><\/p>\r\n<p style=\"text-align: justify\"><em>A. Abstract characteristics<\/em><\/p>\r\n<p style=\"text-align: justify\">Our sample of 186 original research abstracts comprised 38 (20.4%) oral communications, 20 (10.8%) best posters, and 128 (68.8%) poster presentations. All abstracts employed the AMRaC (Aims, Methods, Results and Conclusion) format, with the exception of two unstructured abstracts that were presented in the symposiums. The most common topics covered were in the areas of curriculum (<em>N<\/em>=54, 29.0%), teaching and learning (<em>N<\/em>=53, 28.5%), assessment (<em>N<\/em>=19, 10.2%), and e-learning (<em>N<\/em>=14, 7.5%). Besides Singapore (<em>N<\/em>=62, 33.3%), there was a good mix of abstracts from other countries in the South-East Asian region such as Malaysia, Indonesia, Thailand, Philippines and Myanmar (<em>N<\/em>=19, 10.2%), and other parts of Asia (<em>N<\/em>=88, 47.3%). Most of the studies involved a single institution (<em>N<\/em>=169, 90.9%). Kirkpatrick\u2019s learner outcomes were applicable in approximately half (<em>N<\/em>=94, 50.5%) of the abstracts, with level one (satisfaction, attitudes and opinions of the learners) accounting for 50 (53.2%) of eligible outcomes, followed by knowledge\/skills (<em>N<\/em>=32, 34.0%). An explicit statement of study intent was absent in 29 (15.6%) of abstracts. Among the remaining abstracts with an aims statement, 8 (4.3%) were incorrectly sited in the methods sections, 20 (10.8%) stated educational objectives instead of study goals, and 10 (5.4%) were incomplete.<\/p>\r\n<p style=\"text-align: justify\"><em>\u00a0B.<span>\u00a0<\/span><\/em><em>Prevalence of research purpose (Table 3)<\/em><\/p>\r\n<p style=\"text-align: justify\">Description research purpose was the most common (<em>N<\/em>=122, 65.6%), followed by justification (<em>N<\/em>=40, 21.5%) and clarification (<em>N<\/em>=24, 12.9%). The majority of clarification studies pertain to models (<em>N<\/em>=20, 83.3%), with the reminder involving theory (<em>N<\/em>=3, 12.5%) or hypothesis (<em>N<\/em>=1, 4.2%). The prevalence of clarification studies was higher in non-experimental (<em>N<\/em>=17, 18.3%) compared with experimental (<em>N<\/em>=7, 7.5%) studies. Conversely, for justification studies, the prevalence is higher for experimental (<em>N<\/em>=36, 38.7%) compared with non-experimental (<em>N<\/em>=4, 4.3%) studies.<\/p>\r\n<div class=\"table-responsive\">\r\n<table class=\"table table-bordered\">\r\n<tbody>\r\n<tr>\r\n<td><strong>Study<\/strong><\/td>\r\n<td><strong>N<\/strong><\/td>\r\n<td><strong>Nature of abstracts<\/strong><\/td>\r\n<td><strong>Descriptive<span>\u00a0<\/span><em>N<\/em>(%)<\/strong><\/td>\r\n<td><strong>Justification<span>\u00a0<\/span><em>N<\/em>(%)<\/strong><\/td>\r\n<td><strong>Clarification<span>\u00a0<\/span><em>N<\/em>(%)<\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Lim et al, 2016<\/td>\r\n<td>186<\/td>\r\n<td>APMEC 2012 conference abstracts, not limited to particular study type<\/td>\r\n<td>122 (65.6)<\/td>\r\n<td>40 (21.5)<\/td>\r\n<td>24 (12.9)*<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Experimental<\/td>\r\n<td>93<\/td>\r\n<td><\/td>\r\n<td>50 (53.8)<\/td>\r\n<td>36 (38.7)<\/td>\r\n<td>7 (7.5)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Non-experimental<\/td>\r\n<td>93<\/td>\r\n<td><\/td>\r\n<td>72 (77.4)<\/td>\r\n<td>4 (4.3)<\/td>\r\n<td>17 (18.3)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Schmidt, 2005<\/td>\r\n<td>850<\/td>\r\n<td>Studies on problem-based learning, not limited to particular study type<\/td>\r\n<td>543 (63.9)<\/td>\r\n<td>248 (29.2)<\/td>\r\n<td>59 (6.9)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Cook et al, 2008<\/td>\r\n<td>105<\/td>\r\n<td>Experimental studies from 6 major journals published in 2003-4<\/td>\r\n<td>17 (16.2)<\/td>\r\n<td>75 (71.4)<\/td>\r\n<td>13 (12.4)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Garcia-Duran et al, 2011<\/td>\r\n<td>265<\/td>\r\n<td>UNAM 2008 and 2010 conference abstracts, not limited to particular study type<\/td>\r\n<td>246 (92.8)<\/td>\r\n<td>18 (6.8)<\/td>\r\n<td>1 (0.4)<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p style=\"text-align: center\">APMEC: Asia-Pacific Medical Education Conference; UNAM: Universidad Nacional Aut\u00f3noma de M\u00e9xico<br \/>\r\n*Comprises 83.3% Models, 12.5% theory and 4.2% hypothesis.<br \/>\r\nTable 3. Comparison of research purpose among various studies<\/p>\r\n<p style=\"text-align: justify\"><em>C.<span>\u00a0<\/span><\/em><em>Relationship of variables with research purpose (Table 4)<\/em><\/p>\r\n<p style=\"text-align: justify\">There was no significant association between research purpose with research category, professional group, country of study, and number of institutions (Table 4). Learner outcomes of Kirkpatrick\u2019s level 2 and above were more likely to have a justification or clarification research purpose (c<sup>2<\/sup><span>\u00a0<\/span>[4,<span>\u00a0<\/span><em>N<\/em>=186] = 67.12,<span>\u00a0<\/span><em>p<\/em>&lt;.001), as were studies with a clear statement of study objectives (c<sup>2<\/sup><span>\u00a0<\/span>[2,<span>\u00a0<\/span><em>N<\/em>=186] = 10.51,<span>\u00a0<\/span><em>p<\/em>=.005). Experimental studies were less likely than non-experimental to involve a description purpose (c<sup>2<\/sup><span>\u00a0<\/span>[2,<span>\u00a0<\/span><em>N<\/em>=186] = 29.26,<span>\u00a0<\/span><em>p<\/em>=&lt;.001) even though the frequency of clarification studies was comparatively lower (7.5% vs 18.3%). Non-descriptive studies were more likely to have a justification or clarification purpose (c<sup>2<\/sup><span>\u00a0<\/span>[2,<span>\u00a0<\/span><em>N<\/em>=186] = 71.70,<span>\u00a0<\/span><em>p<\/em>=&lt;.001).<\/p>\r\n<p style=\"text-align: justify\"><em>D. Logistic Regression (Table 5)<\/em><\/p>\r\n<p style=\"text-align: justify\">We included in the model three independent variables (statement of study intent, Kirkpatrick\u2019s outcome levels and descriptive research approach) which were significant in bivariate analysis. Experimental design was not included due to multicollinearity resulting from high correlation with Kirkpatrick\u2019s levels. The Hosmer-Lemeshow test was non-significant (c<sup>2<\/sup><span>\u00a0<\/span>[5,<span>\u00a0<\/span><em>N<\/em>=186] = 1.78,<span>\u00a0<\/span><em>p<\/em>=.881), indicating goodness of fit of the final model. The presence of a clear study aim [Odds ratio (95% CI) = 5.33(1.17 \u2013 24.38)] and non-descriptive research approach [Odds ratio (95% CI) = 4.70(1.50 \u2013 14.71)] but not higher Kirkpatrick\u2019s outcome levels, independently predicted a clarification research purpose.<\/p>\r\n<div class=\"table-responsive\">\r\n<table class=\"table table-bordered\">\r\n<tbody>\r\n<tr>\r\n<td width=\"186\"><strong>Characteristic<\/strong><\/td>\r\n<td width=\"126\"><strong>Description\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 N (%)<\/strong><\/td>\r\n<td width=\"131\"><strong>Justification\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 N (%)<\/strong><\/td>\r\n<td width=\"127\"><strong>Clarification\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 N (%)<\/strong><\/td>\r\n<td width=\"55\"><strong><em>P<\/em><\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Study category<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">.765<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Poster<\/td>\r\n<td width=\"126\">88 (68.8)<\/td>\r\n<td width=\"131\">25 (19.5)<\/td>\r\n<td width=\"127\">15 (11.7)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Best Poster<\/td>\r\n<td width=\"126\">12 (60.0)<\/td>\r\n<td width=\"131\">5 (25.0)<\/td>\r\n<td width=\"127\">3 (15.0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Orals<\/td>\r\n<td width=\"126\">22 (57.9)<\/td>\r\n<td width=\"131\">10 (26.3)<\/td>\r\n<td width=\"127\">6 (15.8)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Professional Group<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">.143<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Postgraduate Medical<\/td>\r\n<td width=\"126\">35 (74.5)<\/td>\r\n<td width=\"131\">9 (19.1)<\/td>\r\n<td width=\"127\">3 (6.4)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Undergraduate Medical, Clinical<\/td>\r\n<td width=\"126\">49 (62.0)<\/td>\r\n<td width=\"131\">18 (22.8)<\/td>\r\n<td width=\"127\">12 (15.2)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Undergraduate Medical, Basic Science<\/td>\r\n<td width=\"126\">20 (64.5)<\/td>\r\n<td width=\"131\">8 (25.8)<\/td>\r\n<td width=\"127\">3 (9.7)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Nursing<\/td>\r\n<td width=\"126\">7 (53.8)<\/td>\r\n<td width=\"131\">1 (7.7)<\/td>\r\n<td width=\"127\">5 (38.5)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Allied Health<\/td>\r\n<td width=\"126\">2 (40.0)<\/td>\r\n<td width=\"131\">2 (40.0)<\/td>\r\n<td width=\"127\">1 (20.0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Country of study<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">.492<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Singapore<\/td>\r\n<td width=\"126\">39 (62.9)<\/td>\r\n<td width=\"131\">16 (25.8)<\/td>\r\n<td width=\"127\">7 (11.3)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">South-East Asia, excluding Singapore<\/td>\r\n<td width=\"126\">11 (57.9)<\/td>\r\n<td width=\"131\">6 (31.6)<\/td>\r\n<td width=\"127\">2 (10.5)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Asia, excluding South-East Asia<\/td>\r\n<td width=\"126\">61 (69.3)<\/td>\r\n<td width=\"131\">14 (15.9)<\/td>\r\n<td width=\"127\">13 (14.8)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Europe<\/td>\r\n<td width=\"126\">4 (44.4)<\/td>\r\n<td width=\"131\">4 (44.4)<\/td>\r\n<td width=\"127\">1 (11.1)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">North America<\/td>\r\n<td width=\"126\">3 (100)<\/td>\r\n<td width=\"131\">0 (0)<\/td>\r\n<td width=\"127\">0 (0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Number of institutions studied<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">.857<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">1<\/td>\r\n<td width=\"126\">111 (65.7)<\/td>\r\n<td width=\"131\">37 (21.9)<\/td>\r\n<td width=\"127\">21 (12.4)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">2<\/td>\r\n<td width=\"126\">4 (57.1)<\/td>\r\n<td width=\"131\">2 (28.6)<\/td>\r\n<td width=\"127\">1 (14.3)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">&gt;2<\/td>\r\n<td width=\"126\">7 (70.0)<\/td>\r\n<td width=\"131\">1 (10.0)<\/td>\r\n<td width=\"127\">2 (20.0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Kirkpatrick\u2019s learner outcomes<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">&lt;.001<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Not applicable<\/td>\r\n<td width=\"126\">73 (79.3)<\/td>\r\n<td width=\"131\">5 (5.4)<\/td>\r\n<td width=\"127\">14 (15.2)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Kirkpatrick\u2019s level 1<\/td>\r\n<td width=\"126\">40 (80.0)<\/td>\r\n<td width=\"131\">7 (14.0)<\/td>\r\n<td width=\"127\">3 (6.0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Kirkpatrick\u2019s level 2 and above<\/td>\r\n<td width=\"126\">9 (20.5)<\/td>\r\n<td width=\"131\">28 (63.6)<\/td>\r\n<td width=\"127\">7 (15.9)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Aims statement<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">.005<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Absent or unclear<\/td>\r\n<td width=\"126\">52 (77.6)<\/td>\r\n<td width=\"131\">13 (19.4)<\/td>\r\n<td width=\"127\">2 (3.0)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Present, clear aims<\/td>\r\n<td width=\"126\">70 (58.8)<\/td>\r\n<td width=\"131\">27 (22.7)<\/td>\r\n<td width=\"127\">22 (18.5)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Experimental study<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">&lt;.001<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Yes<\/td>\r\n<td width=\"126\">50 (53.8)<\/td>\r\n<td width=\"131\">36 (38.7)<\/td>\r\n<td width=\"127\">7 (7.5)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">No<\/td>\r\n<td width=\"126\">72 (77.4)<\/td>\r\n<td width=\"131\">4 (4.3)<\/td>\r\n<td width=\"127\">17 (18.3)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Descriptive study<\/td>\r\n<td width=\"126\"><\/td>\r\n<td width=\"131\"><\/td>\r\n<td width=\"127\"><\/td>\r\n<td width=\"55\">&lt;.001<\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">Yes<\/td>\r\n<td width=\"126\">94 (92.2)<\/td>\r\n<td width=\"131\">3 (2.9)<\/td>\r\n<td width=\"127\">5 (4.9)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<tr>\r\n<td width=\"186\">No<\/td>\r\n<td width=\"126\">28 (33.3)<\/td>\r\n<td width=\"131\">37 (44.0)<\/td>\r\n<td width=\"127\">19 (22.6)<\/td>\r\n<td width=\"55\"><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p style=\"text-align: center\">Table 4. Relationship of variables with research purpose<\/p>\r\n<div class=\"table-responsive\">\r\n<table class=\"table table-bordered\">\r\n<tbody>\r\n<tr>\r\n<td><strong>\u00a0<\/strong><\/td>\r\n<td><strong>b<\/strong><\/td>\r\n<td><strong>S.E.<\/strong><\/td>\r\n<td><strong>Wald<\/strong><\/td>\r\n<td><strong><em>P<\/em><\/strong><\/td>\r\n<td><strong>Odds ratio (95% CI)<\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Clear study aims<\/td>\r\n<td>1.67<\/td>\r\n<td>.78<\/td>\r\n<td>4.66<\/td>\r\n<td>.031*<\/td>\r\n<td>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 5.33\r\n\r\n<p>(1.17 \u2013 24.38)<\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>No outcomes^<\/td>\r\n<td>-.17<\/td>\r\n<td>.73<\/td>\r\n<td>.06<\/td>\r\n<td>.815<\/td>\r\n<td>1.19\r\n\r\n<p>(0.29 \u2013 4.94)<\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>K2 outcomes and above^<\/td>\r\n<td>-.10<\/td>\r\n<td>.82<\/td>\r\n<td>.02<\/td>\r\n<td>.900<\/td>\r\n<td>0.90\r\n\r\n<p>(0.18 \u2013 4.52)<\/p>\r\n<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Non-Descriptive study<\/td>\r\n<td>1.55<\/td>\r\n<td>.58<\/td>\r\n<td>7.09<\/td>\r\n<td>.008**<\/td>\r\n<td>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 4.70\r\n\r\n<p>(1.50 \u2013 14.71)<\/p>\r\n<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p style=\"text-align: center\">Table 5. Logistic regression predicting likelihood of clarification research purpose<br \/>\r\n*<em>P<\/em><span>\u00a0<\/span>&lt; .05; **<em>P<\/em><span>\u00a0<\/span>&lt; .01<br \/>\r\n^Reference group: Kirkpatrick level one outcomes<br \/>\r\nNagelkerke R square: 0.197<\/p>\r\n<p style=\"text-align: center\"><strong>IV. DISCUSSION<\/strong><\/p>\r\n<p style=\"text-align: justify\">The seminal study by Cook et al. (2008a) ushered in a series of studies that examined research quality through the lenses of research purpose. The underlying premise is that situating the research question and the accompanying study design, methods and analysis within a strong conceptual framework, facilitates the conduct of quality research that transcends the local context, allows transferability of findings, and can lead to new programmes of research (Bordage, 2009; Gill &amp; Griffin, 2009; Beran, Kaba, Caird, &amp; McLaughlin, 2014). By integrating the frameworks of Cook and Ringsted, this systematic review of APMEC 2012 original research abstracts contributes to this conversational turn by extending the Cook framework to include non- experimental studies. The strengths of our study include duplicate review at all stages; standardized definitions of coding categories; clear and detailed description of the methods\/procedures involved; and high inter-rater reliability among the coders.<\/p>\r\n<p style=\"text-align: justify\">The distribution of research purpose in our study is broadly in line with earlier studies. Only around one-eighth of original research studies have a clarification research purpose. Around two-thirds of studies focused on \u201cWhat was done?\u201d description purposes which are not readily transferable beyond the immediate context of the individual study. Nonetheless, the relatively higher proportion of clarification purpose in our cohort vis-\u00e0-vis the 0.4-12.0% reported in earlier studies (Schmidt, 2005; Cook et al., 2008a; Garc\u00eda-Dur\u00e1n et al., 2011) is reassuring (Table 3). Similar to Cook et al. (2008a), experimental studies account for the majority of justification studies. This is unsurprising, given the inherent nature of experimental studies in answering \u201cDoes it work?\u201d question. Conversely, because research approaches such as qualitative and observational studies tend to ask \u201cWhy?\u201d or \u201cHow?\u201d questions, non-experimental designs have a higher proportion of clarification purpose compared with experimental studies (18.3% vs. 7.5%). To promote the further development of medical education scholarship in the Asia-Pacific region, we propose tapping upon regional initiatives like the Asia Pacific Medical Education Network (APME-Net), the Asian Medical Education Association, as well as regional journals such as The Asia-Pacific Scholar, to emphasize clarification studies that promote the wider application of theory which can be affirmed or refuted by the study results.<\/p>\r\n<p style=\"text-align: justify\">Our study also highlighted that a non-descriptive study design, in concert with a clear statement of study aims, each predicted a 5-fold increased odds of a clarification research purpose. Similar to developments in outcomes-based research within the field, we advocate a \u201cdesign-balanced\u201d approach whereby the best study design is one that best answers the research question within a given context (Lim, 2013). While descriptive study designs retain a role in the sharing of innovations and preliminary ideas, we should encourage the greater use of more rigorous non-descriptive study designs where appropriate (Ringsted et al., 2011). For experimental studies, quasi-experimental designs with a control group and true experimental designs characterized by randomization are less likely to overestimate effect size compared with single group pre-\/post-test studies (Cook, Levinson, &amp; Garside, 2011). In non-experimental studies, the plurality of non-descriptive approaches includes qualitative, psychometric, observational and translational research designs (Cheong et al., 2015; Ong et al., 2016).<\/p>\r\n<p style=\"text-align: justify\">Given the fundamental importance of the research question, it is disconcerting that around one-sixth of abstracts lack an explicit objective statement of study aims, whilst another one-fifth have an aims statement that is either incorrectly sited, confused with educational objectives, or incomplete. This may be indicative of poor reporting quality, or more ominously, the lack of a clear research question underpinning the research study (Cook, 2016). A systematic review that evaluates the quality of abstracts of 110 experimental studies reported that essential elements of an informative abstract were often under-reported, especially in unstructured abstracts (Cook et al., 2007b). There is evidence that structured formats improve the quality of reporting of research abstracts (Taddio et al., 1994; Wong et al., 2005; Cook et al., 2007a). Reporting quality is positively associated with superior methodological quality (Cook et al., 2011), which in turn is associated with funding for medical education research (Reed et al., 2007). There is thus a case to be made for the consistent use of structured abstracts with relevant and thoughtful headings beyond the IMRaD (Introduction, Methods, Results and Discussion) format. Where relevant, separate headings for background and aims would neatly cater to the need for both literature review plus an explicit statement of study objectives. In addition, we propose a separate heading for conceptual framework or study hypothesis to spur the development of higher-order clarification studies, and a \u201climitations\u201d heading to prompt researchers to think about more rigorous study designs and outcomes through consideration of the limitations of their current research (Cook et al., 2007b).<\/p>\r\n<p style=\"text-align: justify\">Some limitations are worth highlighting. Our research is based upon conference abstracts, which has a significant word constraint as compared to full-length papers. The validity of our findings is highly dependent on the reporting quality of the abstracts, such that the quality of a research (as judged by research purpose and approach) may be more a reflection of the reporting quality rather than the actual quality of research. Notwithstanding, evidence affirming the positive relationship between reporting and methodological quality lends credence to the validity of assessing conference abstracts as an indirect quality indicator of research (Cook et al., 2011). Moreover, our research involved fairly objective and essential elements of reporting such as study aims and outcomes. Secondly, we choose to focus on specific aspects of quality rather than a more comprehensive evaluation of methodological quality using validated scales such as the medical education research study quality instrument (MERSQI) (Reed et al., 2007). Our approach is compatible with the ongoing debate about what constitutes quality in medical education research, which highlights the pre-eminence of the conceptual framework in framing meaningful research questions that can advance the field (Eva, 2009; Monrouxe &amp; Rees, 2009).<\/p>\r\n<p style=\"text-align: center\"><strong>V. CONCLUSIONS<\/strong><\/p>\r\n<p style=\"text-align: justify\">Taken together, our study identified gaps that will, hopefully, serve to promote further discourse among medical education scholars in the region about the purpose and approach of their research inquiry. To advance the research agenda of the Asia-Pacific region, we should tap upon regional platforms to promote clarification studies that employ more rigorous research approaches beyond cross-sectional descriptive study designs. The thoughtful use of structured abstracts to facilitate ancillary factors such as a clear aims statement that makes explicit the underlying conceptual framework, and study design, can also pave the way towards addressing gaps in research purpose and approach.<\/p>\r\n<p style=\"text-align: center\"><strong>Notes on Contributor<\/strong><\/p>\r\n<p style=\"text-align: justify\">W. S. Lim planned and executed the study, performed statistical analysis, and wrote the manuscript. K. M. Tham, F. B. Adzahar, H. Y. Neo, and W. C. Wong contributed to acquisition of data. C. Ringsted contributed to the conception and design of the study. All authors were involved in the critical revision of the paper and approved the \ufb01nal manuscript for publication.<\/p>\r\n<p style=\"text-align: center\"><strong>Acknowledgements<\/strong><\/p>\r\n<p style=\"text-align: justify\">The study was supported by an educational research grant from the National Healthcare Group Health Outcomes and Medical Education Research office.<\/p>\r\n<p style=\"text-align: center\"><strong>Declaration of Interest<\/strong><\/p>\r\n<p style=\"text-align: justify\">All authors have no potential conflicts of interest.<\/p>\r\n<p style=\"text-align: center\"><strong>References<\/strong><\/p>\r\n<p style=\"text-align: justify\">Albert, M., Hodges, B., &amp; Regehr, G. (2007). Research in Medical Education: Balancing Service and Science.\u00a0<em>Advances in Health Sciences Education<\/em>,<span>\u00a0<\/span><em>12<\/em>(1), 103-115.<\/p>\r\n<p style=\"text-align: justify\">Baernstein, A., Liss, H. K., Carney, P. A., &amp; Elmore, J. G. (2007). Trends in study methods used in undergraduate medical education research, 1969-2007.<span>\u00a0<\/span><em>JAMA<\/em>,\u00a0<em>298<\/em>(9), 1038-1045.<\/p>\r\n<p style=\"text-align: justify\">Beran, T. N., Kaba, A., Caird, J., &amp; McLaughlin, K. (2014). The good and bad of group conformity: a call for a new programme of research in medical education.\u00a0<em>Medical Education<\/em>,\u00a0<em>48<\/em>(9), 851-859.<\/p>\r\n<p style=\"text-align: justify\">Bordage, G. (2009). Conceptual frameworks to illuminate and magnify.\u00a0<em>Medical Education<\/em>,\u00a0<em>43<\/em>(4), 312-319.<\/p>\r\n<p style=\"text-align: justify\">Bunniss, S., &amp; Kelly, D. R. (2010). Research paradigms in medical education research.\u00a0<em>Medical Education<\/em>,\u00a0<em>44<\/em>(4), 358-366.<\/p>\r\n<p style=\"text-align: justify\">Cheong, C.Y., Merchant, R.A., Ngiam, N.S.P. &amp; Lim, W.S. (2015). Case-based simulated patient sessions in Mental-State Examination teaching.<span>\u00a0<\/span><em>Med Education, 49(11),<\/em><span>\u00a0<\/span>1147-8.<\/p>\r\n<p style=\"text-align: justify\">Colliver, J. A., &amp; McGaghie, W. C. (2008). The reputation of medical education research: quasi-experimentation and unresolved threats to validity.<span>\u00a0<\/span><em>Teaching and Learning in Medicine<\/em>,<span>\u00a0<\/span><em>20<\/em>(2), 101-103.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A., Beckman, T. J., &amp; Bordage, G. (2007a). Quality of reporting of experimental studies in medical education: a systematic review.\u00a0<em>Medical Education<\/em>,\u00a0<em>41<\/em>(8), 737-745.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A., Beckman, T. J., &amp; Bordage, G. (2007b). A systematic review of titles and abstracts of experimental studies in medical education: Many informative elements missing.\u00a0<em>Medical Education<\/em>,\u00a0<em>41<\/em>(11), 1074-1081.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A., Bordage, G., &amp; Schmidt, H. G. (2008a). Description, justification and clarification: a framework for classifying the purposes of research in medical education.\u00a0<em>Medical Education<\/em>,\u00a0<em>42<\/em>(2), 128-133.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A., Bowen, J. L., Gerrity, M. S., Kalet, A. L., Kogan, J. R., Spickard, A., &amp; Wayne, D. B. (2008b). Proposed standards for medical education submissions to the Journal of General Internal Medicine.\u00a0<em>Journal of General Internal Medicine<\/em>,\u00a0<em>23<\/em>(7), 908-913.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A., Levinson, A. J., &amp; Garside, S. (2011). Method and reporting quality in health professions education research: a systematic review.\u00a0<em>Medical Education<\/em>,\u00a0<em>45<\/em>(3), 227-238.<\/p>\r\n<p style=\"text-align: justify\">Cook, D. A. (2016). Tips for a great review article: crossing methodological boundaries.<span>\u00a0<\/span><em>Medical Education<\/em>,<span>\u00a0<\/span><em>50<\/em>(4), 384-387.<\/p>\r\n<p style=\"text-align: justify\">Creswell, J. W. (2013).\u00a0<em>Research design: Qualitative, quantitative, and mixed methods approaches<\/em>. Sage publications.<\/p>\r\n<p style=\"text-align: justify\">Crites, G. E., Gaines, J. K., Cottrell, S., Kalishman, S., Gusic, M., Mavis, B., &amp; Durning, S. J. (2014). Medical education scholarship: An introductory guide: AMEE Guide No. 89.\u00a0<em>Medical Teacher<\/em>,\u00a0<em>36<\/em>(8), 657-674.<\/p>\r\n<p style=\"text-align: justify\">Eva, K. W., &amp; Lingard, L. (2008). What\u2019s next? A guiding question for educators engaged in educational research.\u00a0<em>Medical Education<\/em>,\u00a0<em>42<\/em>(8), 752-754.<\/p>\r\n<p style=\"text-align: justify\">Eva, K. W. (2009). Broadening the debate about quality in medical education research.\u00a0<em>Medical education<\/em>,\u00a0<em>43<\/em>(4), 294-296.<\/p>\r\n<p style=\"text-align: justify\">Fraenkel, J.R., &amp; Wallen, N.E. (2003).<span>\u00a0<\/span><em>How to design and evaluate research in education. New York<\/em>: NY: McGraw-Hill.<\/p>\r\n<p style=\"text-align: justify\">Garc\u00eda-Dur\u00e1n, R., Morales-L\u00f3pez, S., Durante-Montiel, I., Jim\u00e9nez, M., &amp; S\u00e1nchez-Mendiola, M. (2011). Type of research papers in medical education meetings in Mexico: an observational study. Paper presented at the Annual Meeting of the Association for Medical Education in Europe, Vienna, Austria.<\/p>\r\n<p style=\"text-align: justify\">Gibbs, T., Durning, S., &amp; Van Der Vleuten, C. (2011). Theories in medical education: Towards creating a union between educational practice and research traditions.\u00a0<em>Medical teacher<\/em>,\u00a0<em>33<\/em>(3), 183-187.<\/p>\r\n<p style=\"text-align: justify\">Gill, D., &amp; Griffin, A. E. (2009). Reframing medical education research: let\u2019s make the publishable meaningful and the meaningful publishable.\u00a0<em>Medical Education<\/em>,\u00a0<em>43<\/em>(10), 933-935.<\/p>\r\n<p style=\"text-align: justify\">Gruppen, L.D. (2007). Improving medical education research.\u00a0<em>Teaching and learning in medicine<\/em>,\u00a0<em>19<\/em>(4), 331-335.<\/p>\r\n<p style=\"text-align: justify\">Gwee, M. C., Samarasekera, D. D., &amp; Chong, Y. (2012). APMEC 2013: In Celebration of Innovation and Scholarship in Medical and Health Professional Education.\u00a0<em>Medical Education<\/em>,\u00a0<em>46<\/em>(s2), iii-iii.<\/p>\r\n<p style=\"text-align: justify\">Gwet, K. (1991).<span>\u00a0<\/span><em>Handbook of Inter-Rater Reliability<\/em>. STATAXIS Publishing Company.<\/p>\r\n<p style=\"text-align: justify\">Hodges, B. (2013). Assessment in the post-psychometric era: Learning to love the subjective and collective.\u00a0<em>Medical Teacher<\/em>,\u00a0<em>35<\/em>(7), 564-568.<\/p>\r\n<p style=\"text-align: justify\">Kirkpatrick, D.L. (1967). Evaluation of training. In<span>\u00a0<\/span><em>Training and development handbook<\/em>, edited by R. L. Craig and L. R. Bittel. New York: McGraw-Hill. Pp. 87-112.<\/p>\r\n<p style=\"text-align: justify\">Lim, W. S. (2013). More About the Focus on Outcomes Research in Medical Education.\u00a0<em>Academic Medicine<\/em>,\u00a0<em>88<\/em>(8), 1052.<\/p>\r\n<p style=\"text-align: justify\">Monrouxe, L.V., &amp; Rees, C. E. (2009). Picking up the gauntlet: constructing medical education as a social science.\u00a0<em>Medical Education<\/em>,\u00a0<em>43<\/em>(3), 196-198.<\/p>\r\n<p style=\"text-align: justify\">Ong, Y.H.,\u00a0 Lim, I., Tan, K.T., Chan, M. &amp; Lim, W.S. (2016). Assessing Shared Leadership in Interprofessional Team Meetings: A Validation Study.<span>\u00a0<\/span><em>The Asia Pacific Scholar, 1<\/em>(1)<em>,<\/em><span>\u00a0<\/span>10-21.<\/p>\r\n<p style=\"text-align: justify\"><strong>\u00a0<\/strong>Reed, D. A., Cook, D.A., Beckman, T. J., Levine, R. B., Kern, D. E., &amp; Wright, S. M. (2007). Association between funding and quality of published medical education research.\u00a0<em>JAMA<\/em>,\u00a0<em>298<\/em>(9), 1002-1009.<\/p>\r\n<p style=\"text-align: justify\">Reed, D. A., Beckman, T. J., Wright, S. M., Levine, R. B., Kern, D. E., &amp; Cook, D. A. (2008). Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM\u2019s Medical Education Special Issue.\u00a0<em>Journal of General Internal Medicine<\/em>,\u00a0<em>23<\/em>(7), 903-907.<\/p>\r\n<p style=\"text-align: justify\">Rees, C. E., &amp; Monrouxe, L. V. (2010). Theory in medical education research: how do we get there?.\u00a0<em>Medical Education<\/em>,\u00a0<em>44<\/em>(4), 334-339.<\/p>\r\n<p style=\"text-align: justify\">Ringsted, C., Hodges, B., &amp; Scherpbier, A. (2011). \u2018The research compass\u2019: An introduction to research in medical education: AMEE Guide No. 56.\u00a0<em>Medical Teacher<\/em>,\u00a0<em>33<\/em>(9), 695-709.<\/p>\r\n<p style=\"text-align: justify\">Reeves, S., Boet, S., Zierler, B., &amp; Kitto, S. (2015). Interprofessional Education and Practice Guide No. 3: Evaluating interprofessional education.\u00a0<em>Journal of interprofessional care<\/em>, 29(4), 305-312.<span>\u00a0<\/span><a href=\"https:\/\/doi.org\/10.3109\/13561820.2014.1003637\">https:\/\/doi.org\/10.3109\/13561820.2014.1003637<\/a>.<\/p>\r\n<p style=\"text-align: justify\">Schmidt, H.G. (2005). Influence of research in practices in medical education: the case of problem-based learning. Paper presented at the Annual Meeting of the Association for Medical Education in Europe, Amsterdam, The Netherlands.<\/p>\r\n<p style=\"text-align: justify\">Shea, J. A., Arnold, L., &amp; Mann, K. V. (2004). A RIME perspective on the quality and relevance of current and future medical education research.<span>\u00a0<\/span><em>Academic Medicine<\/em>,\u00a0<em>79<\/em>(10), 931-938.<\/p>\r\n<p style=\"text-align: justify\">Taddio, A., Pain, T., Fassos, F. F., Boon, H., Ilersich, A. L., &amp; Einarson, T. R. (1994). Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association.\u00a0<em>CMAJ: Canadian Medical Association Journal<\/em>,\u00a0<em>150<\/em>(10), 1611.<\/p>\r\n<p style=\"text-align: justify\">Todres, M., Stephenson, A., &amp; Jones, R. (2007). Medical education research remains the poor relation.\u00a0<em>BMJ: British Medical Journal<\/em>,\u00a0<em>335<\/em>(7615), 333.<\/p>\r\n<p style=\"text-align: justify\">Wong, G. (2016). Literature reviews in the health professions: It\u2019s all about the theory.\u00a0<em>Medical education<\/em>,\u00a0<em>50<\/em>(4), 380-382.<\/p>\r\n<p style=\"text-align: justify\">Wong, H. L., Truong, D., Mahamed, A., Davidian, C., Rana, Z., &amp; Einarson, T. R. (2005). Quality of structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association: a 10-year follow-up study.<span>\u00a0<\/span><em>Current Medical Research and Opinion\u00ae<\/em>,\u00a0<em>21<\/em>(4), 467-473.<\/p>\r\n<p style=\"text-align: justify\">Yardley, S., &amp; Dornan, T. (2012). Kirkpatrick\u2019s levels and education \u2018evidence\u2019.<span>\u00a0<\/span><em>Medical Education<\/em>,\u00a0<em>46<\/em>(1), 97-106.<\/p>\r\n<p style=\"text-align: justify\">*Wee Shiong Lim<br \/>\r\nDepartment of Geriatric Medicine<br \/>\r\nTan Tock Seng Hospital<br \/>\r\n11 Jalan Tan Tock Seng, TTSH Annex 2, Level 3<br \/>\r\nSingapore 308433<br \/>\r\nTel: +65 6359 6474<br \/>\r\nEmail: Wee_Shiong_Lim@ttsh.com.sg<\/p>","protected":false},"featured_media":0,"parent":0,"menu_order":3,"template":"","issues_category":[12],"archive_category":[],"issue_type":[],"volume_category":[32],"class_list":["post-461","issues","type-issues","status-publish","hentry","issues_category-original-articles","volume_category-volume-2-number-2-may-2017"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar\" \/>\n<meta property=\"og:description\" content=\"Published online: 2 May, TAPS 2017, 2(2), 8-17 DOI: https:\/\/doi.org\/10.29060\/TAPS.2017-2-2\/OA1004 Wee Shiong Lim1,2, Kar Mun Tham3, Fadzli Baharom Adzahar, Han Yee Neo4, Wei Chin Wong1\u00a0&amp; Charlotte Ringsted5 1Department of Geriatric Medicine, Tan Tock Seng Hospital, Singapore;\u00a02Health Outcomes and Medical Education Research, National Healthcare Group, Singapore;\u00a03Yong Loo Lin School of Medicine, National University of Singapore, Singapore;\u00a04Department [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/\" \/>\n<meta property=\"og:site_name\" content=\"The Asia Pacific Scholar\" \/>\n<meta property=\"article:modified_time\" content=\"2022-04-25T09:21:27+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"30 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/\",\"url\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/\",\"name\":\"Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar\",\"isPartOf\":{\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/#website\"},\"datePublished\":\"2020-02-12T05:18:59+00:00\",\"dateModified\":\"2022-04-25T09:21:27+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/medicine.nus.edu.sg\/taps\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Determinants of clarification research purpose in medical education research: A systematic review\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/medicine.nus.edu.sg\/taps\/#website\",\"url\":\"https:\/\/medicine.nus.edu.sg\/taps\/\",\"name\":\"The Asia Pacific Scholar\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/medicine.nus.edu.sg\/taps\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/","og_locale":"en_US","og_type":"article","og_title":"Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar","og_description":"Published online: 2 May, TAPS 2017, 2(2), 8-17 DOI: https:\/\/doi.org\/10.29060\/TAPS.2017-2-2\/OA1004 Wee Shiong Lim1,2, Kar Mun Tham3, Fadzli Baharom Adzahar, Han Yee Neo4, Wei Chin Wong1\u00a0&amp; Charlotte Ringsted5 1Department of Geriatric Medicine, Tan Tock Seng Hospital, Singapore;\u00a02Health Outcomes and Medical Education Research, National Healthcare Group, Singapore;\u00a03Yong Loo Lin School of Medicine, National University of Singapore, Singapore;\u00a04Department [&hellip;]","og_url":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/","og_site_name":"The Asia Pacific Scholar","article_modified_time":"2022-04-25T09:21:27+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"30 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/","url":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/","name":"Determinants of clarification research purpose in medical education research: A systematic review - The Asia Pacific Scholar","isPartOf":{"@id":"https:\/\/medicine.nus.edu.sg\/taps\/#website"},"datePublished":"2020-02-12T05:18:59+00:00","dateModified":"2022-04-25T09:21:27+00:00","breadcrumb":{"@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/medicine.nus.edu.sg\/taps\/issues\/determinants-of-clarification-research-purpose-in-medical-education-research-a-systematic-review\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/medicine.nus.edu.sg\/taps\/"},{"@type":"ListItem","position":2,"name":"Determinants of clarification research purpose in medical education research: A systematic review"}]},{"@type":"WebSite","@id":"https:\/\/medicine.nus.edu.sg\/taps\/#website","url":"https:\/\/medicine.nus.edu.sg\/taps\/","name":"The Asia Pacific Scholar","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/medicine.nus.edu.sg\/taps\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues\/461","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues"}],"about":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/types\/issues"}],"wp:attachment":[{"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/media?parent=461"}],"wp:term":[{"taxonomy":"issues_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issues_category?post=461"},{"taxonomy":"archive_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/archive_category?post=461"},{"taxonomy":"issue_type","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/issue_type?post=461"},{"taxonomy":"volume_category","embeddable":true,"href":"https:\/\/medicine.nus.edu.sg\/taps\/wp-json\/wp\/v2\/volume_category?post=461"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}