Development of an On-Call Assessment Tool for Competency-Based Surgical Training
Abstract
Introduction: A central tenet of competency-based medical education is formative assessment of trainees. There are no assessments examining resident competence on-call, despite this being a significant component of resident training and characterized by less supervision compared to daytime.
Methods: A national survey was conducted to evaluate the state of assessment in Canadian Plastic and Reconstructive Surgery programs. An on-call assessment tool was developed based on a consensus group and was piloted over six months. Validity of the tool was examined through qualitative and quantitative methods.
Results: There were 63 tools completed across ten residents and seven staff physicians. Tool reliability was 0.67 and scores were significantly correlated to year of training. Staff and residents considered the tool useful, feasible and acceptable.
Conclusions: The on-call assessment tool has multiple sources of validity evidence to support its purpose of assessing surgical resident competence on-call. Further research is required to assess tool generalizability.