Objective <p>This study evaluates ChatGPT’s accuracy and reproducibility in answering patient inquiries about cochlear implantation.</p> Method <p>Forty-one questions were compiled from cochlear implant company websites, clinics, patient support groups, and social media. Questions were categorized into five topics: basic knowledge, information on surgery process, expected results and limitations, answering questions from candidates and families, and technical features of cochlear implant. ChatGPT was queried, and two audiologists and one ENT specialist independently assessed responses for accuracy and reproducibility. Responses were rated as: (1) comprehensive/correct, (2) incomplete/partially correct, (3) a mix of accurate and inaccurate/misleading and (4) completely inaccurate/irrelevant.. Reproducibility was evaluated by repeating questions and analyzing grading consistency.</p> Results <p>ChatGPT provided “comprehensive/correct” answers for 34/41 (82.9%) questions, while 12.2% were “incomplete/partially correct” and 4.9% contained a mix of accurate and inaccurate/misleading. No responses were completely inaccurate. By category, it correctly answered 100% of “basic knowledge” and “technical features of cochlear implant” questions, 60% on “information on surgery process,” 80% on “expected results and limitations,” and 88.9% on “answering questions from candidate and families.” Reproducibility was 82.9%.</p> Conclusion <p>ChatGPT demonstrates strong accuracy and consistency in responding to cochlear implantation questions. While some limitations exist, it can serve as a useful resource for patients and healthcare providers. With continued improvements, ChatGPT has the potential to enhance clinical counseling.</p> Level of evidence <p>N/A.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ChatGPT as an information source for cochlear implants: A study on accuracy and reproducibility

  • Ozlem Icoz,
  • Aysun Parlak Kocabay

摘要

Objective

This study evaluates ChatGPT’s accuracy and reproducibility in answering patient inquiries about cochlear implantation.

Method

Forty-one questions were compiled from cochlear implant company websites, clinics, patient support groups, and social media. Questions were categorized into five topics: basic knowledge, information on surgery process, expected results and limitations, answering questions from candidates and families, and technical features of cochlear implant. ChatGPT was queried, and two audiologists and one ENT specialist independently assessed responses for accuracy and reproducibility. Responses were rated as: (1) comprehensive/correct, (2) incomplete/partially correct, (3) a mix of accurate and inaccurate/misleading and (4) completely inaccurate/irrelevant.. Reproducibility was evaluated by repeating questions and analyzing grading consistency.

Results

ChatGPT provided “comprehensive/correct” answers for 34/41 (82.9%) questions, while 12.2% were “incomplete/partially correct” and 4.9% contained a mix of accurate and inaccurate/misleading. No responses were completely inaccurate. By category, it correctly answered 100% of “basic knowledge” and “technical features of cochlear implant” questions, 60% on “information on surgery process,” 80% on “expected results and limitations,” and 88.9% on “answering questions from candidate and families.” Reproducibility was 82.9%.

Conclusion

ChatGPT demonstrates strong accuracy and consistency in responding to cochlear implantation questions. While some limitations exist, it can serve as a useful resource for patients and healthcare providers. With continued improvements, ChatGPT has the potential to enhance clinical counseling.

Level of evidence

N/A.