Scholarlink

Purpose <p>To examine how reading grade levels affect stakeholder preferences based on a trade-off between accuracy and readability.</p> Material and methods <p>A retrospective study of 500 radiology reports from academic and community hospitals across five imaging modalities was conducted. Reports were transformed into 11 reading grade levels (7–17) using Gemini. Accuracy, readability, and preference were rated on a 5-point scale by radiologists, physicians, and laypersons. Errors (generalizations, omissions, hallucinations) and potential changes in patient management (PCPM) were identified. Ordinal logistic regression analyzed preference predictors, and weighted kappa measured interobserver reliability.</p> Results <p>Preferences varied across reading grade levels depending on stakeholder group, modality, and clinical setting. Overall, preferences peaked at grade 16, but declined at grade 17, particularly among laypersons. Lower reading grades improved readability but increased errors, while higher grades improved accuracy but reduced readability. In multivariable analysis, accuracy was the strongest predictor of preference for all groups (OR: 30.29, 33.05, and 2.16; <i>p</i> &lt;0 .001), followed by readability (OR: 2.73, 1.70, 2.01; <i>p</i> &lt;0.001).</p> Conclusion <p>Higher-grade levels were generally preferred due to better accuracy, with a range of 12–17. Further increasing grade levels reduced readability sharply, limiting preference. These findings highlight the limitations of unsupervised LLM transformations and suggest the need for hybrid approaches that maintain original reports while incorporating explanatory content to balance accuracy and readability.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Readability versus accuracy in LLM-transformed radiology reports: stakeholder preferences across reading grade levels

  • 期刊论文

  • 发表日期：

    2025年9月29日

查看全文
  • Hong-Seon Lee,
  • Sungjun Kim,
  • Songsoo Kim,
  • Jeongrok Seo,
  • Won Hwa Kim,
  • Jaeil Kim,
  • Kyunghwa Han,
  • Shin Hye Hwang,
  • Young Han Lee

摘要

Purpose

To examine how reading grade levels affect stakeholder preferences based on a trade-off between accuracy and readability.

Material and methods

A retrospective study of 500 radiology reports from academic and community hospitals across five imaging modalities was conducted. Reports were transformed into 11 reading grade levels (7–17) using Gemini. Accuracy, readability, and preference were rated on a 5-point scale by radiologists, physicians, and laypersons. Errors (generalizations, omissions, hallucinations) and potential changes in patient management (PCPM) were identified. Ordinal logistic regression analyzed preference predictors, and weighted kappa measured interobserver reliability.

Results

Preferences varied across reading grade levels depending on stakeholder group, modality, and clinical setting. Overall, preferences peaked at grade 16, but declined at grade 17, particularly among laypersons. Lower reading grades improved readability but increased errors, while higher grades improved accuracy but reduced readability. In multivariable analysis, accuracy was the strongest predictor of preference for all groups (OR: 30.29, 33.05, and 2.16; p <0 .001), followed by readability (OR: 2.73, 1.70, 2.01; p <0.001).

Conclusion

Higher-grade levels were generally preferred due to better accuracy, with a range of 12–17. Further increasing grade levels reduced readability sharply, limiting preference. These findings highlight the limitations of unsupervised LLM transformations and suggest the need for hybrid approaches that maintain original reports while incorporating explanatory content to balance accuracy and readability.