P1198 - Chat GPT in Healthcare: Boon or Bane? Gastroenterology Practitioners’ Perspectives

Karina Fatakhova, MD¹, Royce Perera, ², Sapphire Perera, ³, Sohil Khurana, DO⁴, Pratik Patel, MD⁵, David Kadosh, MD¹, Hassam Ali, MD⁶, Ramona Rajapakse, MD^7
1Mather Hospital/Northwell Health, Port Jefferson, NY; ²Cornell University, Ithaca, NY; ³New York University, New York, NY; ⁴Northwell Health, Port Jefferson, NY; ⁵Mather Hospital/Zucker School of Medicine at Hofstra University, Port Jefferson, NY; ⁶ECU Health Medical Center / Brody School of Medicine, Greenville, NC; ⁷Northwell Health, Mather Hospital, Port Jefferson, NY

Introduction: Chat Generative Pre-trained Transformer (Chat GPT) is an artificial intelligence (AI) chatbot developed by open AI and released in November,2022. Chat GPT’s training comprises a diverse range of internet sources. ChatGPT can provide quick access to medical information, aid clinicians in simplifying tasks and improve patient education. However, using AI, particularly in the medical field, poses several potential concerns and challenges that need to be considered carefully. The purpose of this survey-based study was to assess the perceptions and opinions of gastroenterology practitioners regarding AI and its potential applications.

Methods: Gastroenterology attendings, fellows, and advanced practice providers were invited to participate in an anonymous survey distributed through email and Twitter in May of 2023. Google Forms were used for data collection.

Results: Out of the 50 participants who responded, only 16 (32%) of the survey participants had used ChatGPT. 33 survey participants (67.3%) believed that ChatGPT can assist with documentation and administrative tasks. Other perceived benefits include assistance in clinical decision making and differential diagnoses (n=22, 44.9 %), enhancing patient education and communication (n=26,53.1%), assisting in research (n=31,62%), and improving access to medical information and resources (n=23,46.9%). 23 respondents (46%) did not feel comfortable relying on ChatGPT to help with clinical decision making. 31 respondents (64.6%) expressed concerns regarding its’ accuracy and reliability. Additionally, 34 participants (70.8%) were worried about legal implications. 22 respondents (45%) expressed concerns about patient privacy and impact on the doctor-patient relationship.

Discussion: In this study most participants believed that AI models have the potential to support practitioners. Despite potential benefits from adapting Chat GPT into everyday practice a substantial proportion of respondents expressed concern about relying on AI language models. It is well known that Chat GPT can generate inaccurate, yet convincingly plausible responses, which creates a safety concern in medicine. Additionally, it lacks critical thinking, empathy and human judgement which are essential components of patient care. Chat GPT has the potential to improve healthcare delivery and quality of life for practitioners and patients but, humans must take ultimate responsibility for the technology.




Disclosures:


Karina Fatakhova, MD¹, Royce Perera, ², Sapphire Perera, ³, Sohil Khurana, DO⁴, Pratik Patel, MD⁵, David Kadosh, MD¹, Hassam Ali, MD⁶, Ramona Rajapakse, MD⁷. P1198 - Chat GPT in Healthcare: Boon or Bane? Gastroenterology Practitioners’ Perspectives, ACG 2023 Annual Scientific Meeting Abstracts. Vancouver, BC, Canada: American College of Gastroenterology.