<< Back to the abstract archive
Chatgpt And Burn Injury Management: A New Paradigm For Patient Education
Sumaarg Pandya, BS; Mario Alessandri Bonetti, MD; Hilary Y Liu, BS; Tiffany Jeong, BA; Jenny A Ziembicki, MD; Francesco M Egro, MD
University of Pittsburgh Medical Center Department of Plastic Surgery
2024-01-31
Presenter: Sumaarg Pandya
Affidavit:
I agree with the above statement.
Director Name: Dr. Vu T Nguyen
Author Category: Medical Student
Presentation Category: Clinical
Abstract Category: General Reconstruction
Patients often use Google for their medical questions. With the emergence of artificial intelligence chatbots, such as ChatGPT, patients may turn to such technologies as an alternative source of medical information. This study aims to determine whether ChatGPT provides safe, accurate, and comprehensive medical answers to the most commonly asked questions regarding burn injury and their management by comparing the quality of answers provided by ChatGPT and Google search.
A Google search was conducted using the search term "burn." The ten most searched questions and the answers were recorded. The same questions were asked to ChatGPT. Three burn and trauma surgeons graded the quality of the answers provided by Google and ChatGPT from 1 (poor quality) to 5 (excellent quality) according to the Global Quality Score (GQS). A Wilcoxon paired t-test evaluated the difference in GQS ratings for Google and ChatGPT answers.
Google answers scored an average of 2.80 ± 1.03, indicating that some information was present but important topics were missing. Conversely, ChatGPT-generated answers scored an average of 4.57 ± 0.73, indicating excellent quality responses with high utility to patients. For half of the questions, respondents unanimously preferred for their patients to receive their information from ChatGPT.
This study presents an initial comparison of Google and ChatGPT responses for commonly asked burn injury questions. Based on the feedback of three experienced surgeons, ChatGPT outperforms Google with responses regarding commonly asked questions on burn injury and management. These results highlight the potential of chatbots as a source of patient education.
