This study explores the capabilities of Large Language Models in reasoning over structured clinical knowledge with a focus on temporally dependent monitoring rules. We assess the models’ performance across five real-world patient scenarios derived from a virtual coaching platform in the Trentino Salute 4.0 project. Using a structured prompt and diverse use cases, we examine whether these models can accurately detect and justify rule violations and generate clear, audience-specific explanations for patients and healthcare professionals. The results reveal that while Large Language Models demonstrate potential in interpreting complex, time-sensitive clinical data and adapting communication to different stakeholders, limitations persist in temporal reasoning, explanation consistency, and audience alignment. These findings offer insights into the strengths and challenges of deploying LLMs in personalized and temporally aware healthcare decision support systems. GitHub: https://github.com/IDA-FBK/LLM-Temporal-Clinical-Rea soning

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Assessing Temporal Reasoning of Large Language Models on Structured Temporal Clinical Data

  • Gianluca Apriceno,
  • Tania Bailoni,
  • Mauro Dragoni

摘要

This study explores the capabilities of Large Language Models in reasoning over structured clinical knowledge with a focus on temporally dependent monitoring rules. We assess the models’ performance across five real-world patient scenarios derived from a virtual coaching platform in the Trentino Salute 4.0 project. Using a structured prompt and diverse use cases, we examine whether these models can accurately detect and justify rule violations and generate clear, audience-specific explanations for patients and healthcare professionals. The results reveal that while Large Language Models demonstrate potential in interpreting complex, time-sensitive clinical data and adapting communication to different stakeholders, limitations persist in temporal reasoning, explanation consistency, and audience alignment. These findings offer insights into the strengths and challenges of deploying LLMs in personalized and temporally aware healthcare decision support systems. GitHub: https://github.com/IDA-FBK/LLM-Temporal-Clinical-Rea soning