Performance of artificial intelligence large language models (LLMs) in answering frequently asked questions about isotretinoin

Abstract

OBJECTIVE: In this study, we aimed to examine the responses given by ChatGPT (OpenAI), Copilot (Microsoft), and Gemini (Bard) artificial intelligence applications to questions about the active ingredient isotretinoin in terms of accuracy, readability, applicability, and understandability. MATERIAL AND METHODS: The readability of the answers given by the artificial intelligence programs was evaluated using the Flesch-Kincaid ease score, and the applicability and understandability levels were evaluated using the Patient Education Materials Evaluation Tool scales. The accuracy of the answers was compared by two dermatologists who scored them between 1 and 5. RESULTS: < 0.001). CONCLUSION: While the AI chatbots we used in the study demonstrated reasonable accuracy in answering questions about isotretinoin, they performed limited in terms of readability and usability. These findings suggest that AI programs alone are not sufficient for patient education and need to be improved to simplify responses.

Ähnliche Arbeiten