Characterizing the Effect of Pass/Fail U.S. Medical Licensing Examination Step 1 Scoring in Neurosurgery: Program Directors' Perspectives

World Neurosurg. 2020 Oct:142:e440-e444. doi: 10.1016/j.wneu.2020.07.053. Epub 2020 Jul 17.

Abstract

Background: The neurosurgery match is among the most competitive across all specialties. As a result, numerical Step U.S. Medical Licensing Examination Step 1 scores have historically played a major role in selecting applicants for interviews. With the anticipated change in Step 1 scoring to pass/fail will come significant ramifications for how program directors (PDs) screen and select applicants. The present study characterized the responses of PDs to the change in U.S. Medical Licensing Examination Step 1 scoring and its consequences on medical students applying to neurosurgery.

Methods: After receipt of an institutional review board exemption, a validated 19-item survey was electronically distributed to 99 PDs of neurosurgery training programs as a part of a national study across 30 residency specialties. Descriptive statistical analyses were performed, and statistical significance was determined by nonoverlapping 95% confidence intervals.

Results: A total of 48 responses were obtained (48.5%). Most PDs were men, with a mean age of 52 years, and, on average, had served 7.4 years as a PD. Most PDs (79%) disagreed with binary Step 1 scoring. Most (85%) believed the change will make objective comparison of applicants more difficult, and 83% reported they will begin to require Step 2 clinical knowledge scores with application submission. More than one half (71%) believed medical school reputation will become more important in resident selection. Only 15% believed that pass/fail Step 1 scoring will improve medical student well-being.

Conclusion: Binary Step 1 scoring represents a significant change in medical student evaluations, with consequences for the neurosurgery residency application process. The results from the present study might help guide PD practices and prepare medical students for the anticipated changes to the application process.

Keywords: Applications; Medical student; Pass/fail; Residency; Step 1; USMLE.

MeSH terms

  • Adult
  • Educational Measurement / methods
  • Educational Measurement / standards*
  • Female
  • Humans
  • Internship and Residency / standards*
  • Licensure, Medical / standards*
  • Male
  • Middle Aged
  • Neurosurgery / education*
  • Neurosurgery / standards*
  • Physician Executives / psychology
  • Physician Executives / standards*
  • Surveys and Questionnaires
  • United States