Scholarlink

Background <p>Efficient, validated frailty screening tools are needed to identify high-risk older adults. The electronic frailty index (eFI), derived from diagnostic codes, may under-capture functional deficits, such as those documented in physical therapy (PT) notes.</p> Objective <p>This study evaluated the performance of a standard eFI and an enhanced eFI— augmented with deficits extracted from PT notes using a large language model (LLM)—against a geriatrician-performed frailty index based on a comprehensive geriatric assessment (FI-CGA).</p> Design <p>Retrospective cross-sectional study.</p> Participants <p>Adults with a PT visit within 30 days prior to FI-CGA at a large health system in Boston, MA between March 2018 and September 2024.</p> Main Measures <p>An LLM (GPT4o, Microsoft Azure) was prompted to extract eFI deficits from PT notes. Descriptive statistics were used to report demographics characteristics and performance measures. Discrimination was assessed using AUROC with Delong’s test, and agreement was evaluated using Pearson correlation coefficients.</p> Key Results <p>Among 2413 subjects, 1534 (63.6%) were frail (FI-CGA &gt; = 0.25). The AUROCs for the enhanced eFI compared to standard eFI predicting geriatrician assessed frailty (FI-CGA) was 70.1% vs. 61.4% (<i>p</i> &lt; 0.001). Pearson correlations were 0.756 for the eFI vs. enhanced eFI, 0.239 for the eFI vs. FI-CGA, and 0.365 for the enhanced eFI vs. FI-CGA.</p> Conclusions <p>An LLM-enhanced eFI incorporating functional deficits from PT notes demonstrated improved discrimination and stronger correlation with FI-CGA compared to the standard eFI. Leveraging unstructured narratives from PT notes may improve identification of vulnerable older adults who benefit from early intervention.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Validation of a Large Language Model Enhanced Frailty Index

  • 期刊论文

  • 发表日期：

    2026年4月15日

查看全文
  • Joseph M. Plasek,
  • Marie Leeson,
  • John Lundstedt,
  • Natalie C. Ernecoff,
  • Julie M. Fiskio,
  • Savanna Plombon,
  • Shoshana Streiter,
  • Stephanie Mueller,
  • Stuart Lipsitz,
  • Julia V. Loewenthal,
  • Li Zhou,
  • Anuj K. Dalal

摘要

Background

Efficient, validated frailty screening tools are needed to identify high-risk older adults. The electronic frailty index (eFI), derived from diagnostic codes, may under-capture functional deficits, such as those documented in physical therapy (PT) notes.

Objective

This study evaluated the performance of a standard eFI and an enhanced eFI— augmented with deficits extracted from PT notes using a large language model (LLM)—against a geriatrician-performed frailty index based on a comprehensive geriatric assessment (FI-CGA).

Design

Retrospective cross-sectional study.

Participants

Adults with a PT visit within 30 days prior to FI-CGA at a large health system in Boston, MA between March 2018 and September 2024.

Main Measures

An LLM (GPT4o, Microsoft Azure) was prompted to extract eFI deficits from PT notes. Descriptive statistics were used to report demographics characteristics and performance measures. Discrimination was assessed using AUROC with Delong’s test, and agreement was evaluated using Pearson correlation coefficients.

Key Results

Among 2413 subjects, 1534 (63.6%) were frail (FI-CGA > = 0.25). The AUROCs for the enhanced eFI compared to standard eFI predicting geriatrician assessed frailty (FI-CGA) was 70.1% vs. 61.4% (p < 0.001). Pearson correlations were 0.756 for the eFI vs. enhanced eFI, 0.239 for the eFI vs. FI-CGA, and 0.365 for the enhanced eFI vs. FI-CGA.

Conclusions

An LLM-enhanced eFI incorporating functional deficits from PT notes demonstrated improved discrimination and stronger correlation with FI-CGA compared to the standard eFI. Leveraging unstructured narratives from PT notes may improve identification of vulnerable older adults who benefit from early intervention.