Evaluation of ChatGPT's acne advice.

This study examines the responses given by OpenAI's ChatGPT, an AI chatbot, to questions about acne. Two dermatologists evaluated the responses based on accuracy, completeness, and relevance. The study found that 40% of the responses met satisfactory standards for accuracy, completeness, and relevance. Treatment-related questions had fewer satisfactory responses compared to basic and acne-type questions. The study also assessed the understandability and actionability of the responses using the Patient Education Materials Assessment Tool (PEMAT) and their readability using the Flesch Reading Ease Score (FRES). Overall, the study provides insights into the usefulness and quality of information provided by ChatGPT for acne patients. However, it suggests that while AI models like ChatGPT can be helpful as a preliminary resource, they should not replace thorough consultations with a dermatologist. Further research is needed to evaluate the performance of AI models with less common skin conditions and other natural language models. [Extracted from the article]