10048-co-2 can natural language processing ai be an appropriate “adviser” for brain tumor patients? clinical application and issues on chatgpt

Abstract INTRODUCTION Brain tumors affect approximately 20,000 individuals annually in Japan, with some cases requiring urgent treatment. However, the medical knowledge of non-medical individuals (the general public) is often limited, resulting in delays in seeking treatment even when neurological symptoms are evident. Having appropriate advisors who can encourage medical consultations could potentially improve this situation. While Natural Language Processing AI (NLP-AI) is widely used, its full integration into healthcare remains a work in progress. ChatGPT, a prominent NLP-AI, possesses extensive knowledge and is accessible 24/7 online. We explored the potential of leveraging its advanced capabilities and accessibility in the field of brain tumor management. METHODS To evaluate its ability to guide hospital visits effectively, we simulated various symptoms associated with primary brain tumors and consulted ChatGPT(GPT3.5) as patients. We also assessed how ChatGPT handled unnecessary noise information (unrelated symptoms) during symptom consultations. RESULTS ChatGPT consistently recommended hospital visits for all simulated brain tumor patients and provided appropriate advice regarding the urgency and relevant medical department. Notably, even when patients expressed hesitation and refusal hospital visits, ChatGPT persistently persuaded them to visit the hospital despite the user(patient)'s intention. Despite the introduction of noise information, ChatGPT accurately identified and emphasized the importance of relevant symptoms, prompting appropriate medical attention. However, accuracy declined when excessive noise was present. Additionally, ChatGPT generated concise summaries of medical histories for presentation during hospital visits. DISCUSSION While AI is widely utilized in medical imaging, the comprehensive integration of conversational AI in healthcare is still in progress. ChatGPT, despite not being a healthcare professional, holds potential as an "advisor" with extensive medical knowledge, accessible for consultations at any time, to support brain tumor patients. However, challenges related to accountability and expanding knowledge capabilities remain to be addressed.