Scholarlink

Aim <p>The aim of this study is to evaluate the quality, reliability and readability of the answers given by large language model (LLM) chatbots to frequently asked questions about sudden infant death syndrome (SIDS).</p> Method <p>Three widely used LLM chatbots (ChatGPT 4, ChatGPT − 4o, Gemini 1.5 Pro) were asked 21 questions that parents frequently ask about SIDS. The answers were categorized into three different categories: all questions, general information and preventive questions. The content of the answers was evaluated by two experts. The global quality scale (GQS), the modified DISCERN and five different readability indices were used in the evaluation.</p> Result <p>In the study, the GQS score of ChatGPT 4 was found to be higher in responses to all questions about SIDS (<i>p</i> &lt; 0.05). No statistically significant difference was found between the GQS scores of the responses given by the LLMs in the questions about general knowledge about SIDS and prevention (<i>p</i> &gt; 0.05). When the modified DISCERN scores were evaluated in terms of reliability, Gemini 1.5 Pro had the highest score compared to other language models. There was a statistically significant difference in all questions and general knowledge question category (<i>p</i> &gt; 0.05). In terms of readability, Gemini 1.5 Pro had a higher level of ease of reading than other LLM responses (<i>p</i> &lt; 0.05).</p> Conclusion <p>Large language models have the potential to provide accurate and comprehensive answers in providing parents with quality, reliable, and readable information about SIDS, they also have limitations.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Can large language models provide quality, reliable and readable information about sudden infant death syndrome?

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年1月24日

查看全文
  • Ayla İrem Aydın,
  • Rüya Naz

摘要

Aim

The aim of this study is to evaluate the quality, reliability and readability of the answers given by large language model (LLM) chatbots to frequently asked questions about sudden infant death syndrome (SIDS).

Method

Three widely used LLM chatbots (ChatGPT 4, ChatGPT − 4o, Gemini 1.5 Pro) were asked 21 questions that parents frequently ask about SIDS. The answers were categorized into three different categories: all questions, general information and preventive questions. The content of the answers was evaluated by two experts. The global quality scale (GQS), the modified DISCERN and five different readability indices were used in the evaluation.

Result

In the study, the GQS score of ChatGPT 4 was found to be higher in responses to all questions about SIDS (p < 0.05). No statistically significant difference was found between the GQS scores of the responses given by the LLMs in the questions about general knowledge about SIDS and prevention (p > 0.05). When the modified DISCERN scores were evaluated in terms of reliability, Gemini 1.5 Pro had the highest score compared to other language models. There was a statistically significant difference in all questions and general knowledge question category (p > 0.05). In terms of readability, Gemini 1.5 Pro had a higher level of ease of reading than other LLM responses (p < 0.05).

Conclusion

Large language models have the potential to provide accurate and comprehensive answers in providing parents with quality, reliable, and readable information about SIDS, they also have limitations.