Introduction
The purpose of medical education is to acquire comprehensive competence including knowledge, skill, problem solving ability, attitude, etc1). Recently, medical education has put more emphasis on the importance of acquisition of skills and attitudes needed for the betterment of clinical performance, different from the past which emphasized simply on knowledge acquisition. As it is widely perceived that doctors freshly graduated from medical school lack in clinical performance ability, reformation of medical education has been rising in our society2∼4). These days the importance of implementing interview training for medical students has been underscored because it is reported that effective interpersonal communication between patient and doctor can increase satisfaction, leading to an increase of patient compliance and treatment effect by forming good patient-physician interaction (PPI)5∼8). As the fact that it is possible for patient-physician interaction to improve by training becomes known9,10), many medical colleges seek methods to instruct and appraise skills and attitude as well as knowledge.
Since the 1980’s, Problem Based Learning (PBL), Standardized Patients (SP), Simulation, Role-play, etc., have been tried as teaching methods and objective structured clinical examination (OSCE), clinical performance examination (CPX), etc. have been developed as clinical skills assessment tools. In Korea, they have been widely utilized in colleges and medical board examination since several years ago. Recently, role-play has been used actively for the following reasons. First, it is a safe method because it is not likely to damage real patients. Moreover it is possible that students can repeatedly observe and practice in the environment similar to the real one and this motivates students to study hard. For these reasons, role-play is widely practiced as a training and assessment method in many medical colleges11,12).
In colleges of Korean medicine, OSCE and CPX have been used as an assessment tool for clinical clerkship since 2011 and many attempts have been made such as studies of Pulse Simulator13), Standardized Patient14), role-play program15) and so on. However, there was no study on the effectiveness of role-play in dermatology diseases. Thus, the department of Ophthalmology & Otolaryngology & Dermatology at the Korean medical school of Dongguk University conducted patient and doctor role-play as one tool of participatory clinical training in order to improve students’ ability of clinical performance and consultation skills, and assess the effectiveness of the role-play on clinical performance education through student satisfaction survey and evaluation of skills and consultation ability.
Subjects and Method
In 2013, in the clinical clerkship coursework of dermatology department, 79 seniors in the college of Korean medicine participated in the role-play as groups of 6 or 7 people. To begin with, a medical resident explained the objective of the role-play and lectured students on the basic knowledge required for consultation with patients. A few days later, two students were randomly chosen in each group. One student carried out the role of doctor, and the other took the role of patient after he/she had thoroughly read an instruction which described the patient skin condition and history. Highly prevalent skin diseases such as atopic dermatitis, psoriasis and acne were selected as cases and the symptoms of each case were given to students to act as the patient. Clinical pictures of skin lesions and the results of pulse and tongue diagnosis were provided to students who acted as the doctor only when they really conducted an action to a patient (Table 1).
The 1st role-play proceeded for about 15 minutes and a medical resident observed and assessed the student who conducted the role of doctor (Table 2). In the 2nd role-play, the two students swapped roles and another case was used. After the two role-plays were finished, the medical resident gave a brief account of the cases and provided them with feedback. Afterward, the students filled in a questionnaire (Table 3).
The evaluation form and questionnaire were developed on the basis of previous domestic research related to clinical practice training and evaluation of Western medicine12,13) and were made up of multiple-choice questions.
The questionnaire and the evaluation form used five scale ratings by Likert, such as Strongly disagree (1), Disagree (2), Neither agree nor disagree (3), Agree (4), Strongly agree (5). Collected data was processed using SPSS 12.0 for Windows and reliability of each question was evaluated by the value of Cronbach’s α, and in order to figure out the general features of the research target, frequency and percentage were estimated. Also, we assessed the mean, standard deviation, frequency of response and percentage from each questionnaire and evaluation form. To get the difference of evaluation scores according to the order of the role-play, we used t-test, setting up the significance level, P<0.05.
Result
1. General features of research participants
At first, as a result of analyzing reliability of questionnaire and evaluation form, Cronbach’s of the entire items were 0.878 and 0.901. And among 79 students, 50 were male (63.3%) and 29 were female (36.7%). In addition, concerning age distribution, 21∼25 years old were 48 students (60.8%), 26∼30 years old were 12 students (15.2%), and over 31 years old were 19 students (24.0%) (Table 4).
2. Satisfaction with the role-play exercise
A total of 20 questions were asked to students to assess their satisfaction level; the mean and standard deviation of each question are as follows (Table 5). Overall mean score of the total questions was 4.30. That of Q1∼7 which are relevant to the satisfaction with the role-play as a clinical performance was 4.55 and of Q8∼20 which correspond to effectiveness was 4.17.
1) Method satisfaction aspect
Seven questions were about the interest and adequacy of the role-play as a clinical clerkship. The number of respondents and ratio of responses for each question are as follows (Table 6).
2) Efficiency aspect
Thirteen questions were about the efficiency of the role-play as an educational method. The number of respondents and ratio of responses for each question are as follows (Table 6).
3. Score difference between the 1st and 2nd role-play
We set up a t-test on 15 assessment questions to identify the score difference as the role-play proceeded. In 12 questions, except for E6 and E13, the 2nd role-play had a higher mean score than the 1st role-play. However, this difference was not statistically significant (P<0.05) (Table 7).
Discussion & Conclusion
The roles of primary physicians are to be equipped with basic clinical knowledge and to treat a patient based on discovered problems by comprehending various clinical situations. Since physicians conducting these roles need a balanced capacity in three parts, being knowledge, skills and attitude, medical colleges should provide students with opportunities to learn these three aspects equally. Given the reality that Korean medical students mostly engage in primary care after graduation, there are problems which do not satisfy the objective of clinical training because clinical training education based on passive-observation such as visiting outpatient clinics, lectures, ward rounds is not able to offer concrete experience required for understanding actual situations in clinic16).
In order to make up for those problems in clinical training education, simulation training methods have been attracting attention and role-play is one type of simulation, along with standardized patients and mannequins. Learning methods using a patient simulator have advantages because they can reduce the gap between theory and practice by repetitively practicing patient cases under secure conditions where patients are not harmed and under conditions similar to actual situations. In addition, students can effectively apply their knowledge, and they can get a grip on correct and insufficient parts of their decision-making process through feedback17). There are several studies showing that role-play is suitable for students to enhance satisfaction about clinical practice training, confidence, and learning motivation, and to improve critical thinking and decision making ability in clinic18∼20).
Although the importance of effective clinical practice training has been emphasized for real clinical practice, in Korean medical colleges, only one college has instituted OSCE and CPX, and related research is also deficient. Therefore, our department estimated the efficacy of role-play in clinical practice training by attempting role-play similar to actual tasks and did a survey on student satisfaction and evaluated the improvement of students’ skill and interview ability.
Two students were randomly selected out of 79 seniors during dermatology clinical practice. First, one student took the doctor’s role and the other played the patient’s role while a medical resident observed the role-play. After finishing the first role-play, they swapped roles and carried out the second role-play using another clinical case. When the two role-plays had been completed, the medical resident gave a brief account of the cases and took some time for discussion about what went well and what needs to be improved in role-play with the students. Then, the students filled in a questionnaire about their satisfaction level with clinical practice training, while the medical resident evaluated the ability of the students who played the doctor role in terms of interviewing skills and compared the score acquired in the 1st role-play and that of the 2nd role-play.
For the total 20 survey questions and 15 assessment questions, each reliability coefficient was 0.901 and 0.878 respectively, showing internal coherency as a research tool. Among 79 seniors who participated in the clinical clerkship of dermatology department, 50 students were male (63.3%) and 29 students were female (36.7%). In terms of age distribution, 48 students were 21∼25 years old (60.8%), 12 students were 26∼30 years old (15.2%), and 19 students were over 31 years old (24.0%). Out of two role-plays, in the 1st role-play, 41 students took doctor’s role and in the 2nd role-play, 38 students took a doctor’s role.
According to survey results, considering that the total average score of all questions was 4.30 it seems like the satisfaction of role-play as a clinical practice method is quite high. As a result of questionnaire analysis, in terms of method satisfaction (Q1-7) about interest and appropriacy as educational methods, the total average score was 4.55. Among questions, ‘Q7. I would like to recommend role-play to junior’s clerkship.’ accounts for the highest score of 4.73 and ‘Q1. The role-play class was exciting.’ took the second highest score of 4.69. Even though ‘Q6. I would like to recommend role-play to other departments.’ gained the lowest score of 4.38, we can notice that students consider role-play as a satisfactory and interesting clinical training method in view of the fact that the score results showed a high proportion of 3 to 5 points on the whole
Where it covers availability (Q8-20) composed of knowledge, skill, attitude, and general ability, the total average score was 4.17 points which is lower than the total average score of method satisfaction. ‘Q11. The role-play was useful to be aware the current state of my clinical skill.’ received the highest score of 4.65, and this result indicates that by contrast to conventional knowledge acquisition-oriented education, students were able to recognize their own conditions by actively participating in role-play similar to the actual environment. This is similar to the results, telling that most students are aware of the necessity for knowledge acquisition and in which part they needed supplementary study after simulation training17) and therefore it seems that role-play contributes to arousing motivation for studying. On the other hand, ‘Q13. The role-play was useful to upgrade my skill of acupuncture.’ and ‘Q14. The role-play was useful to upgrade my skill of external medical treatment.’ got relatively low scores of 2.74 and 3.32 respectively. This reflects the idea that it is difficult to improve the skill of acupuncture and external medical treatment through just a one-time experience.
We collected descriptive comments from students about pros and cons and any improvement for the role-play. There were many opinions like ‘I could gain confidence by facing a real environment, giving medical treatment and realized which part I had to study harder because I found out where I was insufficient.’, ‘I got to know my skills and interviewing ability objectively.’, ‘I was interested in the role-play and it brought on the promotion of grasp about diseases.’ and ‘I liked getting feedback.’ As for the disadvantages, there are opinions such as ‘If I lack knowledge about disease, it would not be so helpful.’, and ‘The role-play ran short of reality due to a mismatch between a real patient and the student who pretended to be a patient, I wanted to treat a real patient with consent.’ Also, there were comments like ‘I would like to perform a role-play with various diseases’ ‘It should be carried out regularly rather than just one time.’
To determine whether students’ skill and interview ability improve according to the progress of the role-play, we compared the 1st scores with the 2nd scores of the role-play. The total 15 evaluation items are comprised of one assessment part for interview ability such as making a good interview atmosphere, using easy and understandable terms, making use of non-verbal communication, asking questions from various angles and listening to patients’ words attentively and the other assessment part for skills such as observing skin conditions, making a proper diagnosis and choosing right treatment methods. For 12 out of 15 items, the scores of the 2nd role-play were higher than those of the 1st role-play, but these were not statistically significant (P<0.05). As shown in the result that ‘E6. Does a doctor structure and summarize information at the appropriate time?’ takes the score of 3.68 in the 1st role-play and 3.63 in the 2nd role-play, the question got a lower grade as the role-play proceeded. This seems to be because it is hard to improve capacity of organizing and summarizing information in one or two role-play exercises and it seems that it is necessary to practice several times. ‘E13. Does a doctor carry out proper diagnosis and herbal medicine treatment?’ also occupies a lower grade in the 2nd role-play (3.6 points) than in the 1st role-play (3.63 points); the cause of this result is likely that making a proper diagnosis and treatment depends on differences in students’ usual knowledge.
We got descriptive comments from the students who acted as the doctor in the 2nd role-play about differences when they performed the role-play after observing the student who acted as the doctor in the 1st role-play. Considering that there were many opinions like ‘I was not able to omit the parts overlooked in the 1st role-play.’, ‘I could make up for the faults found in the 1st role-play.’, ‘I could take account of something to be desired from taking the patient’s role in the 1st role-play.‘, we knew that recursive role-play was effective in learning. In fact, there was a result that interview technique was advanced in real patient consult after carrying out role-play21).
This study was insufficient to draw out a conclusion about what effects the role-play has on clinical training in that the number of students was too small as only 79 seniors from one Korean medical school participated, the training period was so limited that role-play was not able to be conducted repeatedly, and cases were assigned to students regardless of their academic levels. Like students’ opinions such as ‘I wish that role-play could be adopted to clinical training of other classes.’, ‘I would like to role-play again after acquiring enough knowledge.’, if diverse cases with various diseases and a number of different levels of cases are developed besides dermatological disease, role-play class would motivate students to study and help them to learn about the knowledge, skill and attitude of the related disease. Also, while this research has conducted the role-play after a brief explanation about three dermatological diseases was given to students for three hours, to be more effective, more organized and sufficient preparation is required such as assigning discussion time about the case after watching one explanatory role-play, and giving a lecture to improve the consultation skill.
Research on the role-play and its effectiveness in clinical performance in the Korean medical school is rarely found. Therefore, even though this research needs to be improved as stated earlier, it is meaningful as a fundamental study for the improvement of the quality of clinical performance education in Korean medical school henceforward. If current clinical clerkship is developed through continuous research and development, it would be able to provide better clinical clerkship education that enhances skill and consultation ability as well as knowledge.