Adaptive hybrid storage and retrieval management in blockchain-IPFS systems: a multi-agent deep reinforcement learning approach
摘要
Hybrid storage systems integrating on-chain and off-chain data offer scalable solutions for big data management. However, current methods rely on static rules that limit adaptability in dynamic environments, causing high retrieval delays and increased storage costs. This study proposes a Multi-Agent Deep Reinforcement Learning (MA-DRL) model to optimize hybrid storage systems. The model comprises a coordinator agent and specialized agents for data categorization, blockchain, IPFS, and cache management. These agents make adaptive decisions based on metadata and receive feedback from Hybrid Smart Contracts (HSC). Extensive simulations evaluate the system in terms of cumulative rewards, retrieval delay, and storage transaction costs. Results show the proposed model significantly outperforms Single-Agent (SA) models, reducing storage transaction cost and retrieval delay by approximately 96% compared to SA. The main contributions are a dynamic MA-DRL system model for hybrid storage and retrieval management, and a DRL-based coordinator agent that improves workload distribution among agents.