Scholarlink

Background <p>Appropriate utilization of imaging in the emergency department (ED) remains an important determinant of health care expenditures and patient throughput. LLMs have demonstrated potential as clinical decision support tools, and may aid in cost-conscious imaging triage in the ED. We aim to evaluate the effectiveness of LLMs in providing accurate, cost-conscious imaging recommendations for ED patients with lower back pain.</p> Methods <p>422 patients presented between December 2017 and June 2018 to the ED of a ~ 1000-bed major urban academic medical center with a chief complaint of lower back pain and received a lumbar spine MRI. The primary outcomes were Hoy et al. (Best Pract Res Clin Rheumatol 24(6):769–781, <CitationRef CitationID="CR1">2010</CitationRef>) alignment of Generative Pre-Trained Transformer 4 (GPT-4)-generated imaging recommendations with ACR criteria, by raw accuracy and Cohen’s κ, and Hoy et al. (Arthritis Rheum 64(6):2028–2037, <CitationRef CitationID="CR2">2012</CitationRef>) professional service resource utilization quantified in work relative value units (wRVUs) under real-world clinical decisions, GPT-4 recommendations, and hypothetical 100% ACR adherence scenarios.</p> <p>GPT-4 was compared with real-world clinical decisions for imaging of lower back pain based on ED triage notes. Resource utilization was analyzed to assess potential savings from GPT-4 recommendations.</p> Results <p>GPT-4 model generated ACR-concordant recommendations for 72.0% (304/422) of cases and demonstrated significant alignment with ACR criteria as measured by Cohen’s κ (0.42,95% CI: [0.35,0.48], <i>p</i> &lt; 0.05). Actual resource utilization was 629 wRVUs. GPT-4 would have used 481.74 wRVUs. 100% adherence to the ACR criteria would have used 481.86 wRVUs.</p> Conclusions <p>Our results support LLMs as possible tools for cost-conscious radiologic decision making in ED back pain evaluation.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Large language models as cost-conscious decision aids in emergency medicine: protocol support for imaging in lower back pain

  • 期刊论文

  • 发表日期：

    2025年11月15日

查看全文
  • Siona Prasad,
  • Arya S. Rao,
  • Mario V. Russo,
  • Soham Ghoshal,
  • Elizabeth Roux,
  • Chau Vo,
  • John Kim,
  • Joshua A. Hirsch,
  • Michael H. Lev,
  • Rajiv Gupta,
  • William H. Marks,
  • Amine Korchi,
  • Adam Landman,
  • Bernardo C. Bizzo,
  • Ali S. Raja,
  • Keith J. Dreyer,
  • Marc D. Succi

摘要

Background

Appropriate utilization of imaging in the emergency department (ED) remains an important determinant of health care expenditures and patient throughput. LLMs have demonstrated potential as clinical decision support tools, and may aid in cost-conscious imaging triage in the ED. We aim to evaluate the effectiveness of LLMs in providing accurate, cost-conscious imaging recommendations for ED patients with lower back pain.

Methods

422 patients presented between December 2017 and June 2018 to the ED of a ~ 1000-bed major urban academic medical center with a chief complaint of lower back pain and received a lumbar spine MRI. The primary outcomes were Hoy et al. (Best Pract Res Clin Rheumatol 24(6):769–781, 2010) alignment of Generative Pre-Trained Transformer 4 (GPT-4)-generated imaging recommendations with ACR criteria, by raw accuracy and Cohen’s κ, and Hoy et al. (Arthritis Rheum 64(6):2028–2037, 2012) professional service resource utilization quantified in work relative value units (wRVUs) under real-world clinical decisions, GPT-4 recommendations, and hypothetical 100% ACR adherence scenarios.

GPT-4 was compared with real-world clinical decisions for imaging of lower back pain based on ED triage notes. Resource utilization was analyzed to assess potential savings from GPT-4 recommendations.

Results

GPT-4 model generated ACR-concordant recommendations for 72.0% (304/422) of cases and demonstrated significant alignment with ACR criteria as measured by Cohen’s κ (0.42,95% CI: [0.35,0.48], p < 0.05). Actual resource utilization was 629 wRVUs. GPT-4 would have used 481.74 wRVUs. 100% adherence to the ACR criteria would have used 481.86 wRVUs.

Conclusions

Our results support LLMs as possible tools for cost-conscious radiologic decision making in ED back pain evaluation.