A fine-tuned large language model chatbot for multi-scenario radiology cancer care: randomized controlled trial on interaction optimization, emotional support, and provider burnout reduction
摘要
Cancer patients are more prone to depression and anxiety symptoms compared to those with chronic diseases. Amidst surging clinical demands and constrained medical resources, the traditional radiology workflows, plagued by inefficient communication, exacerbates both patients’ psychological distress and healthcare providers’ burnout.
ObjectiveTo develop and validate a fine-tuned DeepSeek R1-based Radiology Examination Chatbot (REC) to optimize clinical interaction between cancer patients and radiology healthcare providers (RHPs), thereby effectively providing emotional support for cancer patients and reducing burnout among RHPs.
Design, setting, and participantsAudio recordings of multi-scenarios (appointment triage (AT), pre-examination preparation (PP), radiology clinic services (RCS)) were collected from the radiology departments of three tertiary hospitals (n = 36,511 min). This study conducts two independent randomized controlled sub-trials for distinct patient groups: Sub-trial 1 evaluates AT/PP participants (1,424 patients, 1:1 randomized to RHP + REC or RHP), while Sub-trial 2 assesses RCS participants (638 patients, 1:1 randomized to the same groups). Due to differing patient populations, the sub-trials were designed and implemented separately.
InterventionThe REC was fine-tuned using domain-specific dialogue data (80% for training) and scenario-specific prompts, with GPT-o1 as a comparative benchmark. Sub-trials randomized patients to RHP + REC or RHP groups.
Main outcome and measuresThe primary outcome included dialogue quality (empathy, frustration, emotional regulation, factuality, integrity, and satisfaction), while the secondary outcomes comprised burnout (exhaustion, depersonalization, and personal achievement) and image quality (CT/MRI), all assessed via Likert scales and statistical tests.
ResultsRHP + REC group demonstrated superior dialogue quality in AT (factuality: 4.12 ± 0.86 vs. 3.39 ± 1.21, P < 0.001) and PP (satisfaction: 3.73 ± 0.11 vs. 3.19 ± 0.18, P < 0.001), with reduced burnout (exhaustion: 1.85 ± 0.91 vs. 2.40 ± 1.22, P < 0.01). CT image quality improved significantly (4.35 ± 0.51 vs. 4.00 ± 0.52, P < 0.01), and similar results were achieved in MRI examinations (4.12 ± 0.51 vs. 3.79 ± 0.58, P = 0.02). However, REC underperformed in empathy and emotional regulation during emotionally complex RCS (3.88 ± 0.67 vs. 4.42 ± 0.53, P = 0.002; 3.87 ± 0.19 vs. 4.12 ± 0.27, P = 0.004). Ablation studies confirmed the necessity of fine-tuning and scenario-specific prompts for performance.
Conclusion and relevanceOverall, the DeepSeek R1-based REC synergistically enhanced multi-scenarios clinical interaction, provided emotional support for cancer patients, and reduced RHPs’ burnout, offering a scalable solution to optimize radiology workflows.
Trial registrationChinese Clinical Trial Registry Registration number: (ChiCTR2500102740||http://www.chictr.org.cn/), Registration Date: 2025-05-26.