Scholarlink

Objectives <p>This study aims to compare the preterm infant care advice generated by ChatGPT with responses from neonatologists in an online medical consultation forum.</p> Study design <p>This cross-sectional study involving 22 evaluators (12 experienced neonatologists and 10 lay users) compared the responses of an AI chatbot (ChatGPT 4o) and online human experts to 60 preterm infant care-related questions from the “Doctor DingXiang” platform accessed in August 2024. Quantitative indicators, including readability, helpfulness, understandability, intent capture, empathy, actionability, accuracy and safety, were used for comparison. Qualitative content analyses were conducted to reveal further more detailed situational information about the differences between them.</p> Results <p>The mean[SD] score for ChatGPT was higher than human experts on the dimensions of helpfulness (4.07 [0.78] vs 3.50 [1.04]), understandability (4.12 [0.73] vs 3.70 [1.01]), intent capture (4.12 [0.75] vs 3.62 [1.01]), empathy (3.98 [0.73] vs 3.45 [1.05]), actionability (3.97 [0.83] vs 3.37 [1.11]), accuracy (3.97 [0.73] vs 3.32 [1.01]) and safety (3.96 [0.72] vs 3.37 [0.97]). (all <i>P</i> &lt;.001) ChatGPT’s responses had few instances of low ratings than human experts’ responses. ChatGPT provided more comprehensive and elaborative information, though its responses exhibited higher semantic richness and were more difficult to read. In contrast, human experts were better at offering personalized advice and emotional support, adjusting responses based on specific contexts.</p> Conclusion <p>ChatGPT can provide satisfactory responses to neonatal medical inquiries. However, further improvements are necessary to enhance the precision, decision support, and contextual awareness.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Comparing physician and artificial intelligence chatbot responses to preterm infant care questions posted to a public medical consultation forum: evaluation study

  • 期刊论文

  • 发表日期：

    2026年4月15日

查看全文
  • Xiaoli Tang,
  • Xiaochen Yang,
  • Daqiao Zhu,
  • Nanping Shen,
  • Yingjia Qian,
  • Junyi Shen,
  • Sha Sha,
  • Wenzhe Hua

摘要

Objectives

This study aims to compare the preterm infant care advice generated by ChatGPT with responses from neonatologists in an online medical consultation forum.

Study design

This cross-sectional study involving 22 evaluators (12 experienced neonatologists and 10 lay users) compared the responses of an AI chatbot (ChatGPT 4o) and online human experts to 60 preterm infant care-related questions from the “Doctor DingXiang” platform accessed in August 2024. Quantitative indicators, including readability, helpfulness, understandability, intent capture, empathy, actionability, accuracy and safety, were used for comparison. Qualitative content analyses were conducted to reveal further more detailed situational information about the differences between them.

Results

The mean[SD] score for ChatGPT was higher than human experts on the dimensions of helpfulness (4.07 [0.78] vs 3.50 [1.04]), understandability (4.12 [0.73] vs 3.70 [1.01]), intent capture (4.12 [0.75] vs 3.62 [1.01]), empathy (3.98 [0.73] vs 3.45 [1.05]), actionability (3.97 [0.83] vs 3.37 [1.11]), accuracy (3.97 [0.73] vs 3.32 [1.01]) and safety (3.96 [0.72] vs 3.37 [0.97]). (all P <.001) ChatGPT’s responses had few instances of low ratings than human experts’ responses. ChatGPT provided more comprehensive and elaborative information, though its responses exhibited higher semantic richness and were more difficult to read. In contrast, human experts were better at offering personalized advice and emotional support, adjusting responses based on specific contexts.

Conclusion

ChatGPT can provide satisfactory responses to neonatal medical inquiries. However, further improvements are necessary to enhance the precision, decision support, and contextual awareness.