Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus.
Publication/Presentation Date
6-1-2022
Abstract
BACKGROUND: Artificial intelligence (AI) methods and AI-enabled metrics hold tremendous potential to advance surgical education. Our objective was to generate consensus guidance on specific needs for AI methods and AI-enabled metrics for surgical education.
STUDY DESIGN: The study included a systematic literature search, a virtual conference, and a 3-round Delphi survey of 40 representative multidisciplinary stakeholders with domain expertise selected through purposeful sampling. The accelerated Delphi process was completed within 10 days. The survey covered overall utility, anticipated future (10-year time horizon), and applications for surgical training, assessment, and feedback. Consensus was agreement among 80% or more respondents. We coded survey questions into 11 themes and descriptively analyzed the responses.
RESULTS: The respondents included surgeons (40%), engineers (15%), affiliates of industry (27.5%), professional societies (7.5%), regulatory agencies (7.5%), and a lawyer (2.5%). The survey included 155 questions; consensus was achieved on 136 (87.7%). The panel listed 6 deliverables each for AI-enhanced learning curve analytics and surgical skill assessment. For feedback, the panel identified 10 priority deliverables spanning 2-year (n = 2), 5-year (n = 4), and 10-year (n = 4) timeframes. Within 2 years, the panel expects development of methods to recognize anatomy in images of the surgical field and to provide surgeons with performance feedback immediately after an operation. The panel also identified 5 essential that should be included in operative performance reports for surgeons.
CONCLUSIONS: The Delphi panel consensus provides a specific, bold, and forward-looking roadmap for AI methods and AI-enabled metrics for surgical education.
Volume
234
Issue
6
First Page
1181
Last Page
1192
ISSN
1879-1190
Published In/Presented At
Vedula, S. S., Ghazi, A., Collins, J. W., Pugh, C., Stefanidis, D., Meireles, O., Hung, A. J., Schwaitzberg, S., Levy, J. S., Sachdeva, A. K., & and the Collaborative for Advanced Assessment of Robotic Surgical Skills (2022). Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus. Journal of the American College of Surgeons, 234(6), 1181–1192. https://doi.org/10.1097/XCS.0000000000000190
Disciplines
Medicine and Health Sciences
PubMedID
35703817
Department(s)
Department of Obstetrics and Gynecology
Document Type
Article