AI-driven diagnosis of vulnerable intracranial atherosclerotic plaques using large language models and vision transformers: a multi-center study
摘要
High-resolution vessel wall imaging (HR-VWI) is essential for diagnosing vulnerable intracranial atherosclerotic plaques, but its interpretation requires expertise. This study investigates the integration of large language models (LLMs) and deep learning (DL) for more efficient diagnosis.
Materials and methodsA retrospective study of symptomatic intracranial atherosclerotic stenosis patients (June 2018–June 2024) was conducted. LLMs (ChatGPT-4o, DeepSeek-V3, and Moonshot AI) were trained on HR-VWI reports to extract diagnostic insights. Additionally, DL models, ResNet50 and Vision Transformer (ViT), were used to classify vulnerable plaques. Diagnostic accuracy, sensitivity, specificity, and time efficiency were evaluated with both junior and senior doctors.
ResultsA total of 1806 plaques from 726 patients were analyzed. ChatGPT-4o exhibited the highest diagnostic performance (AUC: 0.874). Among DL models, ViT outperformed ResNet50 (AUC: 0.913 vs. 0.845). LLMs and ViT significantly improved junior doctors’ diagnostic accuracy and reduced plaque assessment time (from 301 s to 174 s, p < 0.05).
ConclusionThe integration of LLMs and DL models enhanced diagnostic performance and efficiency, especially for junior doctors. This approach could reduce the burden on healthcare systems, particularly in resource-limited settings, by improving diagnostic accuracy and reducing the time required for plaque analysis.
Key Points