USF-LVHN SELECT

Evaluating the Concordance of ChatGPT and Physician Recommendations for Bariatric Surgery.

Publication/Presentation Date

11-19-2024

Abstract

Integrating artificial intelligence (AI) into healthcare prompts the need to measure its proficiency relative to human experts. This study evaluates the proficiency of ChatGPT, an OpenAI language model, in offering guidance concerning bariatric surgery compared to bariatric surgeons. Five clinical scenarios representative of diverse bariatric surgery situations were given to ASMBS-accredited bariatric surgeons and ChatGPT. Both groups proposed medical or surgical management for the patients depicted in each scenario. The outcomes from both the surgeons and ChatGPT were examined and matched with the clinical benchmarks set by the American Society for Metabolic and Bariatric Surgery (ASMBS). There was a high degree of agreement between ChatGPT and physicians on the three simpler clinical scenarios. There was a positive correlation between physicians' and ChatGPT answers for not recommending surgery. ChatGPT's advice aligned with ASMBS guidelines 60% of the time, in contrast to bariatric surgeons, who consistently aligned with the guidelines 100% of the time. ChatGPT showcases potential in offering guidance on bariatric surgery, but it does not have the comprehensive and personalized perspective that doctors exhibit consistently. Enhancing AI's training on intricate patient situations will bolster its role in the medical field.

ISSN

1205-7541

Disciplines

Medical Education | Medicine and Health Sciences

PubMedID

39561352

Department(s)

USF-LVHN SELECT Program, USF-LVHN SELECT Program Students

Document Type

Article

Link to Full Text

Share

COinS