<p>Adaptive Cruise Control (ACC) enhances safety and comfort in autonomous vehicles by maintaining appropriate inter-vehicular distance and speed regulation. Traditional ACC systems based on PID or Model Predictive Control (MPC) often struggle to handle complex, unforeseen traffic scenarios such as sudden braking, pedestrian crossings, or lane changes. Reinforcement Learning (RL) offers an adaptive alternative by enabling policy learning through environment interaction. However, existing RL-based ACC methods frequently suffer from poor smoothness and energy inefficiency under emergency conditions. This work proposes an enhanced RL-based ACC framework that integrates a physics-informed, multi-objective reward function to jointly optimize safety, ride comfort, and energy efficiency. The reward components are normalized and dynamically weighted based on the current driving context, allowing the agent to adaptively prioritize objectives. Vehicular dynamics are explicitly incorporated into the learning process to improve real-world applicability. The system is trained using the DDPG algorithm, which supports continuous control and stable policy convergence. Extensive MATLAB-based simulations were conducted across diverse urban driving scenarios including stop–go traffic, traffic signals, lane changes, and pedestrian interactions. Comparative analysis against PID and MPC-based ACC controllers demonstrates that the proposed framework achieves superior performance in maintaining safe inter-vehicular distance, reducing jerk, and improving energy efficiency. This study validates the feasibility of deploying a computationally efficient, model-free RL-based ACC for robust and safe autonomous driving in dynamic traffic environments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-Objective Reinforcement Learning With Physics-Aware Vehicle Dynamics for Safe and Efficient Adaptive Cruise Control

  • Haneesh K. M.,
  • Jisha P

摘要

Adaptive Cruise Control (ACC) enhances safety and comfort in autonomous vehicles by maintaining appropriate inter-vehicular distance and speed regulation. Traditional ACC systems based on PID or Model Predictive Control (MPC) often struggle to handle complex, unforeseen traffic scenarios such as sudden braking, pedestrian crossings, or lane changes. Reinforcement Learning (RL) offers an adaptive alternative by enabling policy learning through environment interaction. However, existing RL-based ACC methods frequently suffer from poor smoothness and energy inefficiency under emergency conditions. This work proposes an enhanced RL-based ACC framework that integrates a physics-informed, multi-objective reward function to jointly optimize safety, ride comfort, and energy efficiency. The reward components are normalized and dynamically weighted based on the current driving context, allowing the agent to adaptively prioritize objectives. Vehicular dynamics are explicitly incorporated into the learning process to improve real-world applicability. The system is trained using the DDPG algorithm, which supports continuous control and stable policy convergence. Extensive MATLAB-based simulations were conducted across diverse urban driving scenarios including stop–go traffic, traffic signals, lane changes, and pedestrian interactions. Comparative analysis against PID and MPC-based ACC controllers demonstrates that the proposed framework achieves superior performance in maintaining safe inter-vehicular distance, reducing jerk, and improving energy efficiency. This study validates the feasibility of deploying a computationally efficient, model-free RL-based ACC for robust and safe autonomous driving in dynamic traffic environments.