Use of critical incidents to develop a rating form for resident evaluation of faculty teaching

Med Educ. 2006 Dec;40(12):1201-8. doi: 10.1111/j.1365-2929.2006.02631.x.

Abstract

Context: Monitoring the teaching effectiveness of attending physicians is important to enhancing the quality of graduate medical education.

Methods: We used a critical incident technique with 35 residents representing a cross-section of programmes in a teaching hospital to develop a 23-item rating form. We obtained ratings of 11 attending physicians in internal medicine and general surgery from 54 residents. We performed linear and logistic regression analysis to relate the items on the form to the residents' overall ratings of the attending physicians and the programme directors' ratings of the attending physicians.

Results: The residents rated the attending physicians highly in most areas, but lower in provision of feedback, clarity of written communication and cost-effectiveness in making clinical decisions. When we used the residents' overall ratings as the criterion, the most important aspects of attending physicians' teaching were clarity of written communication, cost-effectiveness, commitment of time and energy and whether the resident would refer a family member or friend to the physician. When we used the programme directors' ratings as the criterion, the additional important aspects of performance were concern for the residents' professional well-being, knowledge of the literature and the delivery of clear verbal and written communication.

Conclusions: The critical incident technique can be used to develop an instrument that demonstrates content and construct validity. We found that residents consider commitment of time to teaching and clinical effectiveness to be the most important dimensions of faculty teaching. Other important dimensions include written and verbal communication, cost-effectiveness and concern for residents' professional development.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Attitude of Health Personnel
  • Education, Medical, Graduate / standards*
  • Internship and Residency / standards*
  • Personal Satisfaction
  • Physicians / standards*
  • Task Performance and Analysis
  • Teaching / standards*