|
KMID : 1039620150050000084
|
|
Korean Journal of Family Practice
2015 Volume.5 No. 0 p.84 ~ p.89
|
|
|
Rating Tendencies and Inter-Rater Agreement of Peer Assessment on Medical Students’ Communication Skills
|
|
Jang Ah-Young
Lee Jung-Kwon
Shin Jin-Young
Lee Hae-Young
|
|
|
Abstract
|
|
|
Background : Peer assessment is known to be a useful means of evaluating the clinical competence of medical students. However, few studies have evaluated the utility of medical students’ peer assessment in Korea. This study aimed to evaluate the utility of medical students’ peer assessment by investigating rating tendencies and inter-rater agreement of communication skills.
Methods : Thirty-four students were divided into five groups and a standardized patient was matched with each group. During medical interviewing, their conversation was videotaped. All medical students conducted peer assessments with a modified checklist based on the Calgary-Cambridge observation guides. The rating tendency of peers was evaluated by calculating the frequency of answer choices. Inter-rater agreement of peer assessment was measured by using median values of intra-class correlation coefficients (ICCs) in each group.
Results : Students tended to avoid negative ratings on their peers. The median ICC values were below 0.75 in all categories and below 0.4 in most categories of the checklist. The inter-rater agreement of peer assessment was poor. In particular, understanding patients’ perspective, providing structure to consultation, and building relationships, showed lower agreement than others.
Conclusion : In peer assessments, medical students avoided negative ratings, and the inter-rater agreement of peers was quite low.
|
|
|
KEYWORD
|
|
|
|
|
|
FullTexts / Linksout information
|
|
|
|
|
|
Listed journal information
|
|
 
|