Abstract 4116844: Simplifying Cardiology Research Abstracts: Assessing ChatGPT's Readability and Comprehensibility for Non-Medical Audiences

Abstract

Background: Artificial Intelligence (AI)-powered chatbots like ChatGPT are increasingly used in academic medical settings to help with tasks such as evidence synthesis and manuscript drafting. They have shown potential in simplifying complex medical texts for non-medical audiences like patients and journalists. However, less is known about whether simplified texts may exclude important information or be of interest to patients or other non-medically-trained people such as journalists. Objective: This study aims to assess ChatGPT's capacity to simplify cardiology research abstracts by eliminating jargon and enhancing universal comprehension. Methods: We analyzed all abstracts and scientific statements published from July to November 2023 in Circulation (n=113). These abstracts were processed through ChatGPT with the prompt: "Please rewrite the following text to be comprehensible at a 5th-grade reading level. Retain all original information and exclude nothing". We assessed the readability of both original and simplified texts using Flesch-Kincaid Grade Level (FKGL) and Reading Ease (FKRE) scores. Additionally, a panel of five physicians and five laypeople evaluated these texts for completeness, accuracy, and understandability. Results: ChatGPT transformation or abstracts reduced the required reading level from a college graduate to 8-9th grade by both FKGL (18.3 to 8.6; p<.001) and FKRE (14.6 to 68.5; p<.001). The physician panel generally found that the simplified abstracts retained all essential information without introducing errors. Both physicians and laypeople found the simplified texts more comprehensible. Laypeople appreciated the ease of understanding but did not strongly express a desire for more such simplified texts, and some still worried about the simplified abstracts missing important details. Conclusion: ChatGPT simplifies medical research abstracts to a level understandable by those with less than a high school education without excluding important information. This approach may be useful to communicate new research findings to patients and other non-medically-trained people.

Ähnliche Arbeiten