Inter-rater Reliability Between CIs and DPT Students Using the CPI on Initial, Intermediate and Final Clinical Rotations

Purpose/Hypothesis : Inter-rater reliability of clinical instructors and DPT students is not well documented in the literature. In order to accurately evaluate studentsÕ progress in clinical education, it is imperative that students and clinical instructors are consistent in their assessment of the studentsÕ performance in the clinical setting. The primary research questions: 1. Is there a relationship between CI and student ratings on the CPI? 2. Is there a difference in the CI/student ratings between an initial, intermediate and final clinical rotation? The research hypothesis stated there is a relationship between CI and student ratings on the CPI on initial, intermediate and final clinical rotations.Number of Subjects : 30 clinical instructors and 30 DPT students for each of three clinical rotationsMaterials/Methods : A retrospective analysis of clinical education data was performed. CPI data for 30 DPT students on initial, intermediate, and final clinical rotations were examined. A SpearmanÕs rho (?) correlation was run for each of the 18 criteria on the CPI for an initial, intermediate and final clinical rotation to determine the relationship between the CI and student ratings.Results : Moderate to strong correlations (? = .566 - .750) exist among 17/18 CPI criteria on the initial clinical rotation. Little to no correlation exists among any of the 18 CPI criteria for the intermediate rotation. For the final clinical rotation, weak correlations (? = .385-.499) exist among 7/18 criteria, moderate correlations (? = .516-.676) exist among 10/18 criteria, and a strong correlation (? = .701) exists for 1/18 criteria.Conclusions : The most consistent ratings were seen during the first clinical rotation and the least consistent ratings were seen during the intermediate clinical rotation. Interestingly, despite only weak to moderate correlations for 17/18 CPI criteria during the final clinical rotation, all students were rated at or above entry-level. The variation in rating was based on student/CI marking of entry-level, in between entry-level and beyond entry-level, and beyond entry-level. This is an initial study based on one cohort of students. Future research to cover multiple cohorts could provide additional insight into this area of study.Clinical Relevance : Students and CIs were fairly consistent with CPI scoring for initial and final clinical rotations. However, much variation existed during the intermediate clinical rotation. Continued instruction and training is needed for students and clinical instructors to ensure both parties are scoring the CPI correctly so that studentsÕ progress is accurately assessed on initial, intermediate and final clinical rotations.

BACK to Abstract Results

  • Control #: 1727051
  • Type: Poster
  • Event/Year: CSM2014
  • Authors: Kristie Vinson, David Smith
  • Keywords: CPI|inter-rater reliability|clinical instructors

BACK to Abstract Results