Scholarlink

<p>Automated radiology report generation significantly reduces radiologists’ workload while maintaining high accuracy and readability standards. We propose an Integrated Multimodal Graph-Enhanced Framework (IMGEF) for graph-enhanced integration to generate precise, clinically relevant medical reports. IMGEF leverages the Spatial-aware Graph Embedding Module (SGEM) to aggregate features from neighbouring nodes in a graph while preserving their inherited spatial relationships. It also incorporates the Multimodal Attention-Based Feature Fusion Module (MABFFM), which integrates information from three modalities, image features, textual features, and graph-based features, to produce a unified feature representation. Extensive experiments on the IU X-ray and MIMIC-CXR datasets demonstrate the effectiveness of the IMGEF model, with results highlighting its ability to generate comprehensive, consistent, and accurate reports.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

IMGEF: integrated multimodal graph-enhanced framework for radiology report generation

  • 期刊论文

  • 发表日期：

    2025年5月31日

查看全文
  • Muhammad Usman,
  • Xiaodi Hou,
  • Yi Guo,
  • Zonglin Liang,
  • Zhang Yijia

摘要

Automated radiology report generation significantly reduces radiologists’ workload while maintaining high accuracy and readability standards. We propose an Integrated Multimodal Graph-Enhanced Framework (IMGEF) for graph-enhanced integration to generate precise, clinically relevant medical reports. IMGEF leverages the Spatial-aware Graph Embedding Module (SGEM) to aggregate features from neighbouring nodes in a graph while preserving their inherited spatial relationships. It also incorporates the Multimodal Attention-Based Feature Fusion Module (MABFFM), which integrates information from three modalities, image features, textual features, and graph-based features, to produce a unified feature representation. Extensive experiments on the IU X-ray and MIMIC-CXR datasets demonstrate the effectiveness of the IMGEF model, with results highlighting its ability to generate comprehensive, consistent, and accurate reports.