Scholarlink

<p>Ensuring reliable anomaly detection in industrial robots is critical for safe and autonomous manufacturing operations. However, it remains challenging due to temporal dependencies and class imbalance in sensor data. This study presents a reinforcement learning approach using Deep Q-Network (DQN) enhanced with Long Short-Term Memory (LSTM) and Gradient Boosting Machine (GBM) for robust anomaly detection in robotic systems. The proposed framework integrates an LSTM into the DQN policy to capture temporal patterns. It also introduces a novel GBM-based reward mechanism that mitigates class imbalance by applying SMOTE (Synthetic Minority Over-sampling Technique) after removing temporal dependencies. Experimental results demonstrate that this hybrid DQN-GBM framework achieves superior performance in precision, recall, and F1-score compared to standalone DQN and DQN-LSTM variants. Beyond technical improvements, this approach enables truly autonomous manufacturing environments by providing adaptive, real-time anomaly detection that reduces human intervention and prevents costly production failures, ultimately contributing to more resilient and self-optimizing industrial systems.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Reinforcement Learning for Imbalanced Data in Robotic Anomaly Detection within Autonomous Manufacturing

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月9日

查看全文
  • Salma Messaoudi,
  • Ahmed Bendaouia,
  • El Hassan Abdelwahed,
  • Mohammed Ameksa,
  • Hajar Mousannif,
  • Jianzhi Li

摘要

Ensuring reliable anomaly detection in industrial robots is critical for safe and autonomous manufacturing operations. However, it remains challenging due to temporal dependencies and class imbalance in sensor data. This study presents a reinforcement learning approach using Deep Q-Network (DQN) enhanced with Long Short-Term Memory (LSTM) and Gradient Boosting Machine (GBM) for robust anomaly detection in robotic systems. The proposed framework integrates an LSTM into the DQN policy to capture temporal patterns. It also introduces a novel GBM-based reward mechanism that mitigates class imbalance by applying SMOTE (Synthetic Minority Over-sampling Technique) after removing temporal dependencies. Experimental results demonstrate that this hybrid DQN-GBM framework achieves superior performance in precision, recall, and F1-score compared to standalone DQN and DQN-LSTM variants. Beyond technical improvements, this approach enables truly autonomous manufacturing environments by providing adaptive, real-time anomaly detection that reduces human intervention and prevents costly production failures, ultimately contributing to more resilient and self-optimizing industrial systems.