Can ChatGPT provide reliable answers to frequently asked questions about physical activity?
摘要
The significance of physical activity in enhancing an individual’s health and quality of life is well established. Therefore, it is crucial that individuals have access to accurate information regarding physical activity. This study aims to assess ChatGPT's capacity to provide reliable responses to frequently asked questions concerning physical activity, with a particular emphasis on accuracy, comprehensiveness, and readability.
Subject and methodsTen of the 50 frequently asked questions concerning physical activity that were generated by ChatGPT were selected for evaluation. To assess the responses, ten impartial experts utilized a four-point quality scale. The intraclass correlation coefficient (ICC) was employed to quantify inter-rater reliability, while the Flesch-Kincaid method was utilized to assess readability.
ResultsOverall, the responses were deemed satisfactory. The inter-rater agreement was indicated by an ICC value of 0.814, which is considered to be good. The text was accessible to the majority of readers, as indicated by the readability scores, which ranged from seventh- to eighth-grade level. However, some of the responses lacked adequate detail, highlighting areas that require further development.
ConclusionThe present study demonstrated that the ChatGPT model exhibited good inter-rater reliability and the capacity to furnish satisfactory responses to frequently asked questions concerning physical activity. However, the study also identified limitations and a scarcity of comprehensive data in the responses. These findings suggest that information regarding physical activity requires validation and supervision by experts, necessitating comprehensive and customized guidance.