A blockchain-enabled multi-objective reinforcement learning framework for secure energy- and time-efficient smart path planning in cloud environments
摘要
Path planning for cloud based autonomous systems such as smart transportation, Internet of Things (IoT) installations and robot fleets need to be secure, energy efficient, time efficient and fulfil privacy constraints. Current reinforcement learning (RL) techniques mainly consider optimisation of single objective, centralised or loosely secured model updates which are susceptible to data poisoning, privacy breach and adversarial model updates. We present Blockchain enabled Energy and Time efficient Multi Objective Reinforcement Learning (BlockE2T MORL) a new decentralised approach for secure, cloud assisted path planning. BlockE2T MORL has three main components: (i) a dynamic multi objective reward function that reduces energy, travel time and security threat; (ii) a lightweight blockchain inspired trust mechanism that assigns continuous trust values to agents, and is incorporated in the reward function to punish dishonest or malicious agents; and (iii) a hybrid actor critic learning strategy that facilitates exploration and exploitation in dynamic environments. Unlike conventional blockchain systems, our approach incurs low computational overhead (