How Does the Sequence of the American Board of Surgery Examinations Impact Pass/Fail Outcomes?

Objective: Historically, the American Board of Surgery required surgeons to pass the qualifying exam (QE) prior to taking the certifying exam (CE). However, in the 2020-2021 academic year, with mitigating circumstances related to COVID-19, the ABS removed this sequencing requirement to facilitate the certification process for those candidates who were negatively impacted by a QE exam delivery failure. This decoupling of the traditional order of exam delivery has provided a natural comparator to the traditional route and an analysis of the impact of exam sequencing on candidate performance. Methods: All candidates who applied for the canceled July 2020 QE were allowed to take the CE prior to passing the QE. The sample was then reduced to include only first time candidates to ensure comparable groups for performance outcomes. Logistic regression was used to analyze the relationship between the order of taking the QE and the CE, controlling for other exam performance, IMG status, and gender. Results: Only first-time candidates who took both exams were compared (n=947). Exam sequence was not a significant predictor of QE pass/fail outcomes, OR=0.54; 95% CI, 0.19-1.61, P =0.26. However, exam sequence was a significant predictor of CE pass/fail outcomes, OR=2.54; 95% CI, 1.46-4.68, P =0.002. Conclusion: This important study suggests that preparation for the QE increases the probability of passing the CE and provides evidence that knowledge may be foundational for clinical judgment. The ABS will consider these findings for exam sequencing moving forward.