Aim <p>The significance of physical activity in enhancing an individual’s health and quality of life is well established. Therefore, it is crucial that individuals have access to accurate information regarding physical activity. This study aims to assess ChatGPT's capacity to provide reliable responses to frequently asked questions concerning physical activity, with a particular emphasis on accuracy, comprehensiveness, and readability.</p> Subject and methods <p>Ten of the 50 frequently asked questions concerning physical activity that were generated by ChatGPT were selected for evaluation. To assess the responses, ten impartial experts utilized a four-point quality scale. The intraclass correlation coefficient (ICC) was employed to quantify inter-rater reliability, while the Flesch-Kincaid method was utilized to assess readability.</p> Results <p>Overall, the responses were deemed satisfactory. The inter-rater agreement was indicated by an ICC value of 0.814, which is considered to be good. The text was accessible to the majority of readers, as indicated by the readability scores, which ranged from seventh- to eighth-grade level. However, some of the responses lacked adequate detail, highlighting areas that require further development.</p> Conclusion <p>The present study demonstrated that the ChatGPT model exhibited good inter-rater reliability and the capacity to furnish satisfactory responses to frequently asked questions concerning physical activity. However, the study also identified limitations and a scarcity of comprehensive data in the responses. These findings suggest that information regarding physical activity requires validation and supervision by experts, necessitating comprehensive and customized guidance.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Can ChatGPT provide reliable answers to frequently asked questions about physical activity?

  • Tahir Keskin,
  • Bayram Sönmez Ünüvar,
  • Mesut Ergan,
  • Zeliha Başkurt,
  • Ferdi Başkurt

摘要

Aim

The significance of physical activity in enhancing an individual’s health and quality of life is well established. Therefore, it is crucial that individuals have access to accurate information regarding physical activity. This study aims to assess ChatGPT's capacity to provide reliable responses to frequently asked questions concerning physical activity, with a particular emphasis on accuracy, comprehensiveness, and readability.

Subject and methods

Ten of the 50 frequently asked questions concerning physical activity that were generated by ChatGPT were selected for evaluation. To assess the responses, ten impartial experts utilized a four-point quality scale. The intraclass correlation coefficient (ICC) was employed to quantify inter-rater reliability, while the Flesch-Kincaid method was utilized to assess readability.

Results

Overall, the responses were deemed satisfactory. The inter-rater agreement was indicated by an ICC value of 0.814, which is considered to be good. The text was accessible to the majority of readers, as indicated by the readability scores, which ranged from seventh- to eighth-grade level. However, some of the responses lacked adequate detail, highlighting areas that require further development.

Conclusion

The present study demonstrated that the ChatGPT model exhibited good inter-rater reliability and the capacity to furnish satisfactory responses to frequently asked questions concerning physical activity. However, the study also identified limitations and a scarcity of comprehensive data in the responses. These findings suggest that information regarding physical activity requires validation and supervision by experts, necessitating comprehensive and customized guidance.