<p>Designing optimal chemotherapy schedules remains a fundamental challenge in oncology, requiring a careful balance between effective tumor suppression and the prevention of excessive systemic toxicity. In this study, a deep reinforcement learning-based control framework is proposed for optimizing multi-drug chemotherapy dosing strategies under physiological uncertainty and clinical safety constraints. Specifically, a Double Deep Q-Network (DDQN) algorithm is employed to learn adaptive dosing policies for a three-drug chemotherapy regimen within a dynamic tumor–toxicity modeling environment. The proposed framework optimizes the scheduling of three chemotherapeutic agents represented within a mechanistic PK/PD model using a DDQN approach. A multi-objective reward function is formulated to simultaneously promote tumor reduction while penalizing excessive toxicity and violations of dose constraints. Through simulations over 5000 training episodes and robustness analyses under parameter perturbations up to <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\pm 50\%\)</EquationSource> </InlineEquation>, the DDQN-based controller demonstrates the ability to reduce the tumor population from <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(4.60517 \times 10^{11}\)</EquationSource> </InlineEquation> cells to approximately 42 residual cells while maintaining aggregate toxicity below the imposed safety limit of 300 units, with a mean value of 274. Robustness analyses are conducted under significant physiological parameter variations (up to <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\pm 50\%\)</EquationSource> </InlineEquation>) and abrupt tumor growth disturbances, where the proposed approach consistently maintains bounded state trajectories and avoids constraint violations. These simulation-based results suggest that Double Deep Q-Network reinforcement learning may provide a useful framework for adaptive chemotherapy scheduling under uncertainty. However, further validation using experimentally derived datasets, retrospective clinical cohorts, and prospective studies is required before clinical applicability can be established.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Double deep Q-network-based multi-drug chemotherapy scheduling optimization

  • Behnoush Alizade,
  • Ahmad Hajipour

摘要

Designing optimal chemotherapy schedules remains a fundamental challenge in oncology, requiring a careful balance between effective tumor suppression and the prevention of excessive systemic toxicity. In this study, a deep reinforcement learning-based control framework is proposed for optimizing multi-drug chemotherapy dosing strategies under physiological uncertainty and clinical safety constraints. Specifically, a Double Deep Q-Network (DDQN) algorithm is employed to learn adaptive dosing policies for a three-drug chemotherapy regimen within a dynamic tumor–toxicity modeling environment. The proposed framework optimizes the scheduling of three chemotherapeutic agents represented within a mechanistic PK/PD model using a DDQN approach. A multi-objective reward function is formulated to simultaneously promote tumor reduction while penalizing excessive toxicity and violations of dose constraints. Through simulations over 5000 training episodes and robustness analyses under parameter perturbations up to \(\pm 50\%\) , the DDQN-based controller demonstrates the ability to reduce the tumor population from \(4.60517 \times 10^{11}\) cells to approximately 42 residual cells while maintaining aggregate toxicity below the imposed safety limit of 300 units, with a mean value of 274. Robustness analyses are conducted under significant physiological parameter variations (up to \(\pm 50\%\) ) and abrupt tumor growth disturbances, where the proposed approach consistently maintains bounded state trajectories and avoids constraint violations. These simulation-based results suggest that Double Deep Q-Network reinforcement learning may provide a useful framework for adaptive chemotherapy scheduling under uncertainty. However, further validation using experimentally derived datasets, retrospective clinical cohorts, and prospective studies is required before clinical applicability can be established.