Evaluation in medical education: A topical review of target parameters, data collection tools and confounding factors (2015)

Abstract

BACKGROUND AND OBJECTIVE Evaluation is an integral part of education in German medical schools. According to the quality standards set by the German Society for Evaluation, evaluation tools must provide an accurate and fair appraisal of teaching quality. Thus, data collection tools must be highly reliable and valid. This review summarises the current literature on evaluation of medical education with regard to the possible dimensions of teaching quality, the psychometric properties of survey instruments and potential confounding factors. METHODS We searched Pubmed, PsycINFO and PSYNDEX for literature on evaluation in medical education and included studies published up until June 30, 2011 as well as articles identified in the "grey literature". RESULTS are presented as a narrative review. RESULTS We identified four dimensions of teaching quality: structure, process, teacher characteristics, and outcome. Student ratings are predominantly used to address the first three dimensions, and a number of reliable tools are available for this purpose. However, potential confounders of student ratings pose a threat to the validity of these instruments. Outcome is usually operationalised in terms of student performance on examinations, but methodological problems may limit the usability of these data for evaluation purposes. In addition, not all examinations at German medical schools meet current quality standards. CONCLUSION The choice of tools for evaluating medical education should be guided by the dimension that is targeted by the evaluation. Likewise, evaluation results can only be interpreted within the context of the construct addressed by the data collection tool that was used as well as its specific confounding factors. Abstract available from the publisher.

Bibliographic entry

Schiekirka, S., Feufel, M. A., Herrmann-Lingen, C., & Raupach, T. (2015). Evaluation in medical education: A topical review of target parameters, data collection tools and confounding factors. GMS German Medical Science, 13:doc15. doi:10.3205/000219 (Full text)

Miscellaneous

Publication year 2015
Document type: Article
Publication status: Published
External URL: http://dx.doi.org/10.3205/000219 View
Categories:
Keywords: confounderdimensionevaluationmedical educationquestionnaire

Edit | Publications overview