Social navigation in dynamic human environments requires both efficient goal-directed behavior and robust, anticipatory safety mechanisms. We introduce BPPO-EM, a cognitively inspired reinforcement learning framework that augments Proximal Policy Optimization with Bayesian uncertainty modulation, adaptive learning rate tuning, and episodic memory recall. To enhance real-time safety, BPPO-EM incorporates a predictive collision network and a rule-based safety layer guided by LiDAR perception. In PyBullet simulations over 1000 episodes, BPPO-EM reached the goal in 82.7% of trials, compared to only 17.5% with standard PPO, and reduced the number of episodes with collisions from 60.2% to 15.8%. Moreover, the average number of collisions dropped from 2.19 to 0.50, demonstrating a 4-fold safety improvement. BPPO-EM significantly outperformed standard PPO in average rewards, returns, and goal-directed progress, confirming its effectiveness for socially compliant robot navigation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Bayesian Proximal Policy Optimization with Adaptive Learning and Episodic Memory for Social Robot Navigation

  • Diego Resende Faria

摘要

Social navigation in dynamic human environments requires both efficient goal-directed behavior and robust, anticipatory safety mechanisms. We introduce BPPO-EM, a cognitively inspired reinforcement learning framework that augments Proximal Policy Optimization with Bayesian uncertainty modulation, adaptive learning rate tuning, and episodic memory recall. To enhance real-time safety, BPPO-EM incorporates a predictive collision network and a rule-based safety layer guided by LiDAR perception. In PyBullet simulations over 1000 episodes, BPPO-EM reached the goal in 82.7% of trials, compared to only 17.5% with standard PPO, and reduced the number of episodes with collisions from 60.2% to 15.8%. Moreover, the average number of collisions dropped from 2.19 to 0.50, demonstrating a 4-fold safety improvement. BPPO-EM significantly outperformed standard PPO in average rewards, returns, and goal-directed progress, confirming its effectiveness for socially compliant robot navigation.