Explainable and accurate ENT diagnosis via a dual knowledge LLM
摘要
Artificial intelligence (AI), especially large language models (LLMs), faces a clinical trust gap due to black-box reasoning and factual hallucinations–risks amplified in otorhinolaryngology (ENT), where diagnostic pathways are complex and symptoms overlap. We aim to build an explainable and accurate ENT diagnostic assistant grounded in a dual-knowledge framework.
MethodsWe construct a rule-centric Core Knowledge Graph (KG) distilled from peer-reviewed guidelines and handbooks, and a Contextual Instance Library (CIL) of real-world case narratives. At inference, the system performs dual retrieval–logical KG reasoning for citable rules and dense similarity search for experiential corroboration–then applies schema-constrained prompting to synthesize both streams into auditable reports. Offline, KG/CIL are automated with LLM-based NER/RE, discourse-aware chunking, and vector indexing. Evaluation uses a 251-item ENT question set and curated vertigo cases, compared against base LLMs and standard RAG baselines; explanation quality is assessed with LLM-as-a-judge across multiple generator/judge pairs.
ResultsThe dual system achieves higher diagnostic accuracy than base LLMs and standard RAG baselines and produces consistently superior, citation-backed explanations. Reports explicitly link conclusions to rules and corroborating instances.
ConclusionsIntegrating rule knowledge (KG) with experiential evidence (CIL) simultaneously improves diagnostic accuracy and interpretability, offering a pragmatic path from black-box LLMs to trustworthy, auditable clinical decision support in ENT.