Foundations of Inter-Rater Reliability in Simulation
Inter-rater reliability (IRR) has long been used in many different scientific fields to measure the reliability of the classification of subjects. In simulation, checklists and rubrics are common tools used to assess a learner’s performance, and the use of inter-rater agreements are used to check and maintain assessment integrity across large class sizes with multiple evaluators.
Join Dr. Backlund as he presents the concept of IRR along with the data considerations needed to construct a proper IRR plan and cases when different agreement coefficients should be used.
Learning Objectives
- • Be aware of the concept of IRR
- • Be aware of different data types used for assessment tools
- • Be aware of some general concepts related to the number of evaluators needed
- • Have access to a generalized flow chart for choosing appropriate agreement coefficients
Speaker
Daniel J. Backlund, PhD, CHSOS, CHSE
Senior Director of Simulation IT Integration
Texas Tech University Health Sciences Center
Webinar Info
- Faculty Develoment, Innovate use of Simulation, New Technologies
- 1
- 58 minutes
Breaking down how to calculate IRR to audience who may not have that knowledge base. Great lecturer and humble educator!
Daniel Backlund is a thoughtful speaker and easy to understand. I enjoyed his thorough coverage of IRR. Very helpful!
Very helpful webinar to understand more about inter-rater reliability.
Simplified information. So generous to share all of the resources the speaker talked about. Great production value by the staff in charge of delivering the presentation. Thank you