<< Back to the abstract archive
Consulting Dr. ChatGPT: evaluation of ChatGPT's knowledge on common plastic surgery topics and its potential role in patient education compared to Google
Hilary Y Liu, BS1; Mario Alessandri Bonetti, MD1; Tiffany Jeong, BA1; Sumaarg Pandya, BS1; Marco Palmesano, MD2; Francesca De Lorenzi, MD, PhD3; Michael L Gimbel, MD1; Vu T Nguyen, MD1; Franceso M Egro, MD, MSc, MRCS1
1 Department of Plastic Surgery, University of Pittsburgh Medical Center
2 Department of Plastic Su
2024-01-10
Presenter: Hilary Y Liu
Affidavit:
I agree with the above statement.
Director Name: Vu T Nguyen
Author Category: Medical Student
Presentation Category: Clinical
Abstract Category: Aesthetics
Background: Patients often use Google to find answers to their plastic surgery questions. Due to its surge in popularity, ChatGPT may become a new information source. This study aims to assess the quality of ChatGPT by comparing the answers to frequently asked questions on various plastic surgery topics (free flaps, breast reconstruction, breast implant-associated anaplastic large cell lymphoma, breast implant illness, and body contouring) provided by ChatGPT and Google.
Methods: The Google and ChatGPT answers to the 10 most frequently asked questions on the search terms "free flap surgery," "breast reconstruction," "breast implant associated anaplastic large cell lymphoma," "breast implant illness," and "body contouring surgery" were recorded. Five blinded plastic surgeons assessed the quality of the answers according to the Global Quality Score (GQS). Wilcoxon paired t-tests were performed to compare Google and ChatGPT GQS scores.
Results: For free flap surgery, Google scored 2.49±1.25, whereas ChatGPT scored 4.47±0.84 (p<0.001). For breast reconstruction, Google scored 3.18±1.14, whereas ChatGPT scored 4.34±0.89 (p=0.002). For breast implant-associated anaplastic large cell lymphoma, Google scored 2.72±1.44, whereas ChatGPT scored 4.18±1.04 (p=0.002). For breast implant illness, Google scored 2.66±1.24, while ChatGPT scored 4.28±0.97 (p=0.002). For body contouring, Google scored 2.55±1.29, while ChatGPT scored 4.38±0.67 (p=0.001). When asked which source they would recommend between ChatGPT and Google, most surgeons chose ChatGPT.
Conclusion: ChatGPT outperforms Google in providing high-quality answers to commonly asked questions in plastic surgery. Although ChatGPT has limitations, we foresee the potential of this technology to revolutionize patient education when used in adjunct to clinical counseling.
