An artificial intelligence language model improves readability of burns first aid information

Abstract

Aims: This study aimed to assess the potential of using an artificial intelligence (AI) large language model to improve the readability of burns first aid information.

Methods: An AI language model (ChatGPT-3) was used to rewrite content from the top 50 English-language webpages containing burns first aid information to be understandable by an individual with the literacy level of an 11-year-old, as recommended by the American Medical Association and Health Education England. The assessment of readability was conducted using five validated tools.

Results: In their original form, only 4% of the patient education materials (PEMs) met the target readability level across all tools. The median grade was 6.9 (SD=1.1). One-sample one-tailed t-test revealed that this was not significantly below the target (p = .31). After AI-modification, 18% of PEMs reached the target level using all tools, with a median grade of 6 (SD=0.9), which was significantly below the target level (p < .001). Once rewritten using AI, paired t-test demonstrated that all readability scores improved significantly (p < .001).

Conclusion: Utilising an AI language model proved an effective and viable method for enhancing readability of burns first aid information.

Keywords: Artificial intelligence; Burns; First aid; Health literacy; Internet; Readability.