Breast-CRAG: A Breast Cancer Large Language Model Leveraging Retrieval-Augmented Generation
摘要
The lack of specialized large language models (LLMs) for breast cancer limits their clinical adoption. To address this, we present Breast-CRAG, a 7B-parameter retrieval-augmented LLM specifically optimized for breast cancer applications. Our approach combines a fine-tuned generator (trained on a curated 268K-dialogue dataset) with a specialized retriever (leveraging a 1M-chunk knowledge base) to enhance response quality. Evaluations across four dialogue and two exam datasets demonstrate that Breast-CRAG outperforms comparable open-source models and achieves competitive performance with GPT-4o. Ablation studies confirm the contributions of both components. With its strong performance on clinical queries, Breast-CRAG represents a promising tool for breast cancer care and research.