Machine Learning-Based Autonomous Optimization of Unattended Wireless Sensor Networks Through Multi-Cause Reinforcement Learning
摘要
Self-configuration refers to a node's ability to dynamically adjust resource allocation based on changing network conditions, either autonomously or with minimal human input. Alongside this, self-optimization is aimed at maintaining optimal network performance despite fluctuating conditions. Protocols like MRL-SCSO, designed for Unattended Wireless Sensor Networks (UWSNs), ensure robust coverage, connectivity, and energy efficiency under varying loads. MRL-SCSO employs learning-based mechanisms, such as Reinforcing Multiple Agents, incorporating features like boundary construction, state scheduling, topology control, and data dissemination to enhance network management. When compared to the Collect Tree Protocol (CTP), MRL-SCSO exhibits faster packet transmission due to backbone nodes and traffic load prediction, reducing delays by 2–5 ms, which is a significant improvement over existing algorithms. Additionally, MRL-SCSO delivers a better packet delivery ratio, dropping only by 5–12% with shorter data transmission intervals, while CTP experiences a 20–40% drop when all nodes are active. Furthermore, MRL-SCSO improves throughput by 20–30 kb/s compared to CTP, demonstrating its superior ability to optimize network performance without sacrificing reliability.