ChatGPT’nin kadınlarda alt üriner sistem semptomları ile ilgili soruları yanıtlama performansının değerlendirilmesi

Abstract

OBJECTIVE: ChatGPT is a language model developed by OpenAI. As a language model, ChatGPT can be used for various natural language processing tasks, such as answering questions, providing information, engaging in conversations, and more. We aimed to evaluate ChatGPT’s suitability to accurately inform patients and medical students by analyzing the reliability and accuracy of lower urinary tract symptoms (LUTS) information in women. MATERIAL and METHODS: Systematically organized frequently asked questions from urology association websites, hospitals, and social media platforms regarding lower urinary tract symptoms (LUTS) in women, along with questions compiled from European Association of Urology (EAU) recommendations, were analyzed. All questions were systematically submitted to ChatGPT 3.5 and 4.0 versions. Two expert urologists independently evaluated the data and answers to the questions and assigned scores from 1 to 4 to each answer. RESULTS: A hundred and three frequently asked questions and 36 questions compiled from EAU guideline recommendations regarding LUTS in women were included in the study. 83.50% of the frequently asked questions (85.44% for version 4.0) and 80.56% of the questions compiled from EAU recommendations (80.56% for version 4.0) were rated as ‘completely correct’ (Grade 1). The rate of completely incorrect answers to the questions (Grade 4) was 0.97% in the frequently asked questions group (0.97% for version 4.0) and 2.78% in the guide-based questions group (2.78% for version 4.0). The success rate of both versions in answering questions was found to be close to each other. CONCLUSION: ChatGPT provided acceptable responses to the posed questions. Despite its limitations, we believe that utilizing this continuously evolving platform under the guidance of urologists in urology clinics will contribute to the diagnosis and treatment processes for patients and their families. Keywords: artificial intelligence, ChatGPT, education, female LUTS

Ähnliche Arbeiten