|Year : 2018 | Volume
| Issue : 4 | Page : 298-301
Formative evaluation and learning achievement in epidemiology for preclinical medical students
Varisara Luvira, Sauwanan Bumrerraj, Sompong Srisaenpang
Department of Community Medicine, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand
|Date of Submission||22-Jun-2018|
|Date of Acceptance||10-Oct-2018|
|Date of Web Publication||21-Dec-2018|
Dr. Varisara Luvira
Department of Community Medicine, Faculty of Medicine, Khon Kaen University, Khon Kaen 40002
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background: Teaching epidemiology and biostatistics is a challenge for medical teachers. Formative evaluation has been shown to improve the learning outcomes in various medical subjects. However, the effectiveness of formative evaluation in the subject of epidemiology has yet to be clearly demonstrated. Objective: The aim of this study is to investigate the association between formative evaluation and learning outcomes of medical students. Materials and Methods: We retrospectively reviewed the prospectively collected learning data of 266 third-year medical students who were enrolled in an epidemiology course in 2016. All learning data and outcomes were analyzed. Results: Nearly all students (97.4%) attended the formative evaluation. Learning outcomes were deemed unsatisfactory in 9.8% of cases. Multivariate analysis revealed that gender, the students' medical training program, laboratory attendance, and the amount of calculation students do during the formative examination were factors that were associated with learning outcomes. Conclusion: The formative evaluation was effective at improving learning outcomes in the subject of epidemiology. The parameters indicated that the attention of the medical students, such as laboratory attendance, and the amount of calculation done during the formative examination, were associated with learning outcomes.
Keywords: Biostatistics, epidemiology, formative evaluation, medical education, medical student
|How to cite this article:|
Luvira V, Bumrerraj S, Srisaenpang S. Formative evaluation and learning achievement in epidemiology for preclinical medical students. Indian J Community Med 2018;43:298-301
|How to cite this URL:|
Luvira V, Bumrerraj S, Srisaenpang S. Formative evaluation and learning achievement in epidemiology for preclinical medical students. Indian J Community Med [serial online] 2018 [cited 2019 Nov 20];43:298-301. Available from: http://www.ijcm.org.in/text.asp?2018/43/4/298/248189
| Introduction|| |
Epidemiology and biostatistics, which mostly concern quantitative research and research methodology, are the two of the most important subjects that medical students take., However, some medical students do not place importance on these subjects because they see them as being unrelated to the skills they will need in future medical practice. It is difficult for students to keep up, as they tend to focus their efforts on clinical courses at the expense of their epidemiology and biostatistics courses., This makes teaching these subjects challenging for educators in medical schools.
In the past, summative evaluation was the only way to evaluate students' knowledge and the comprehension in these subjects. This evaluation was usually performed once after completion of the epidemiology course, making it difficult to identify and offer assistance to students having problems in the subject. Formative evaluation performed repeatedly throughout the course offers qualitative feedback regarding medical students' knowledge. Moreover, it provides a chance to improve prospective teaching methods.
There is evidence that formative evaluation can improve the learning outcomes of medical students., At our center, a method of formative evaluation has been adapted to improve students' learning outcomes over the course of 3 years. However, the effectiveness of formative evaluation in the subject epidemiology has yet to be clearly demonstrated.
We, thus, investigated the association between formative evaluation and medical students' learning outcomes to achieve a better understanding of the effectiveness of this tool in teaching epidemiology.
| Materials and Methods|| |
This retrospective study ran between July 2015 and May 2016. We retrospectively reviewed the prospectively collected learning data of 266 3rd-year medical students at Khon Kaen University's Faculty of Medicine. The learning data included number of laboratories attended, formative evaluation scores, final examination scores, and overall grades in the course.
The 3rd-year epidemiology course at our center takes 5 months to complete. The course examined in this study ran from November 2016 to March 2017. The students were also concurrently enrolled in courses in other subjects (i.e., correlated basic medical science and clinical science, introduction to clinical science, and english for medical sciences). During the course, the medical students attended 30 epidemiology lectures and 11 laboratories. The formative evaluation was 3 h long, consisting of 25 multiple choice questions (MCQ), and was performed in the middle of the course. After 20 min had passed from the beginning of the examination, students were allowed to return their answer sheets. All students were given a choice as to whether or not they would attend the evaluation. The final examination consisted of 90 MCQs. The final grades were classified into eight tiers, namely, A, B+, B, C+, C, D+, D, and F, according to a weighted T score based on laboratory performance and final examination score.
This study was reviewed and exempted by the Institutional Review Board, Office of Human Research Ethics, Khon Kaen University (HE601147).
The primary outcome of this study was the learning achievement, which was classified as either “satisfactory” or “unsatisfactory.” The latter was defined as a grade of C or below. We also examined a variety of factors to determine whether or not they affected the learning achievement outcome, including gender, medical training program, attendance of epidemiology laboratories, attendance of the formative evaluation, use of note paper for calculation during the formative evaluation, and time spent taking the formative evaluation.
The descriptive data are presented as median (min: Max), or as number and percentage. Pearson correlation was used to determine the association between two numerical variables. Univariate and multivariate analyses were conducted using the logistic regression model to evaluate potential confounders. A value of P < 0.05 was considered to be statistically significant. All statistical analyses were performed using STATA version 10 (StataCorp LLC, College Station, TX, USA).
| Results|| |
There were 266 3rd-year medical students enrolled in the 2016 school year. The male-to-female ratio was 1:1. Most of the students (60.2%) were in the ordinary program. The remaining students were in the Collaborative Project to Increase Production of Rural Doctors (CPIRD) and One District One Doctor program (ODOD). Ninety-five percent of the students attended all of the laboratories.
Nearly all students (97.4%) attended the formative evaluation. Only 11.7% of those who attended finished the evaluation and returned the answer sheet at 20 min of the examination. During the formative examination, most of the students (54.9%) used more than 50% of the note paper for calculation, whereas only 6.8% did not have any written calculations.
The numbers of the students who received grades of A, B+, B, C+, C, D+, and F were 27 (10.2%), 72 (27.1%), 88 (33.1%), 53 (19.9%), 19 (7.1%), 6 (2.3%), and 1 (0.4%), respectively. According to our definition, the proportion of students with unsatisfactory learning outcomes was 9.8%.
We carried out a univariate analysis of six variables to determine what factors affected students' learning outcomes. We found several significant prognostic factors for satisfactory learning outcomes including gender, laboratory attendance, formative evaluation attendance, and amount of calculation during the formative examination [Table 1]. The significant prognostic factors determined by univariate analysis were then further analyzed via multivariate analysis. This analysis revealed that gender, medical training program, laboratory attendance, and amount of calculation during the formative examination were significant prognostic factors [Table 2]. We also determined the relationship between formative examination and final examination scores using Pearson's correlation and found no correlation (corr. =0.512) between these scores.
|Table 1: Demographic data and univariate analysis of the factors affecting satisfied learning outcome (Grade>C) of the medical students|
Click here to view
|Table 2: Multivariate analysis of factors that affected satisfactory learning outcomes (Grade>C)|
Click here to view
| Discussion|| |
This study showed that medical students' learning achievement could be accurately predicted using various parameters, especially those examined in the formative evaluation. Although students' scores on the formative evaluation were not correlated with those on the final examination, aspects of the formative evaluation process, itself, were able to predict learning outcomes.
Owing to the difficulty of epidemiology, students who spend more time learning the subject and who have more attention tend to have the better learning outcomes. We found that the higher laboratory attendance and more written calculation during the formative evaluation were significantly associated with better learning outcomes. Both of these parameters indicate the attention to epidemiology of the medical students. The evidence suggests that affective entry characteristics are associated with learning outcomes. Moreover, the more time that students spend in the laboratory, the more opportunities they have to practice biostatistics and epidemiology, further increasing their attention. This is the first study showing that the calculation notes that students made were related to learning outcomes.
At our center, there are several programs for medical students. They are categorized into two main programs as follows: the ordinary program and the project to increase the production of rural doctors. The latter is subdivided into ODOD and CPIRD. The medical students in these two programs will work at a rural hospital after they graduate from medical school. This means that these students tend not to concern themselves with epidemiology, instead focusing on subjects that they see as relating to the skills they will need in their future practice. This may explain why the medical students in the ordinary program had better learning outcomes in this subject.
There is significant evidence suggesting that attention is critical to successful learning in any subject.,, Planning of the formative evaluation should not focus only the score but also parameters that indicate the attention of the students. In the same way, assessment of attention should not rely solely on the formative evaluation but also all activities during the first half of the course such as laboratory attendance. This will help identify students who are having difficulties so that educators can focus on them for the remaining duration of the course.
To the best of our knowledge, this is the 1st study to show the benefit of formative evaluation for medical students studying epidemiology. The strengths of this study include the following: (i) it was conducted at a medical school that has a large number of students and (ii) all data were collected prospectively. However, some limitations should be considered. First, the curricula of medical programs in various countries differ. Second, because of the way Thailand's education system is structured, medical students in Thailand are usually younger than those in other countries. Therefore, the findings of the current study should be adapted accordingly if it is to be applied in other countries.
| Conclusion|| |
This study demonstrated the effectiveness of the formative evaluation in the subject of epidemiology. Moreover, we found that parameters indicating medical students' attention were associated with learning outcomes. We suggest that these parameters should be assessed in both the formative evaluation and throughout the course.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Center for Medical Competency Assessment and Accreditation (CMA). Available from: https://www.cmathai.org/
. [Last accessed on 2017 Oct 01].
Ercan I, Ozkaya G, Ocakoglu G, Yazici B, Sezer A, Ediz B, et al
. Determining biostatistics knowledge of students and physicians in medical school. InterStat 2008;3:1-17.
Vasudevan S. Biostatistics teaching to the undergraduate medical students through research-oriented medical education posting program in a teaching medical institute in coastal area of Pondicherry: An experience of a biostatistician. J Pharm Bioallied Sci 2016;8:78-9.
Ernster VL. On the teaching of epidemiology to medical students. Am J Epidemiol 1979;109:617-8.
Novick LF, Greene C, Vogt RL. Teaching medical students epidemiology: Utilizing a state health department. Public Health Rep 1985;100:401-5.
Appleton DR. What statistics should we teach medical undergraduates and graduates? Stat Med 1990;9:1013-21.
Abu-Zaid A. Formative assessments in medical education: A medical graduate's perspective. Perspect Med Educ 2013;2:358-9.
McNulty JA, Espiritu BR, Hoyt AE, Ensminger DC, Chandrasekhar AJ. Associations between formative practice quizzes and summative examination outcomes in a medical anatomy course. Anat Sci Educ 2015;8:37-44.
Bloom BS. Human Characteristics and School Learning. New York: McGraw-Hill; 1976.
Daher AM, Amin F. Assessing the perceptions of a biostatistics and epidemiology module: Views of year 2 medical students from a Malaysian university. A cross-sectional survey. BMC Med Educ 2010;10:34.
Nissen MJ, Bullemer P. Attentional requirements of learning: Evidence from performance measures. Cogn Psychol 1987;19:1-32.
Posner MI, Petersen SE. The attention system of the human brain. Annu Rev Neurosci 1990;13:25-42.
Ashby FG, Maddox WT. Human category learning. Annu Rev Psychol 2005;56:149-78.
[Table 1], [Table 2]