The rapid growth of Internet of Things (IoT) devices and the deployment of unmanned aerial vehicles (UAVs) as aerial base stations (BS) introduce significant challenges in uplink random access for massive machine-type communication (mMTC) networks. This paper proposes a Q-learning-based random access scheme integrated with Sparse Code Multiple Access (SCMA) tailored for UAV-assisted IoT scenarios. By enabling devices to autonomously optimize time slot group selection and codebook allocation through Q-learning, the scheme enhances access success probability and throughput while satisfying practical system constraints. A customized reward function ensures stable learning convergence and efficient resource utilization. Simulation results demonstrate the effectiveness and robustness of the proposed approach in improving access performance under dense device deployments, validating its suitability for scalable and reliable uplink access control in UAV-enabled mMTC networks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Q-Learning-Based Random Access for UAV-Assisted IoT Networks

  • Fan He,
  • Xu Zhao,
  • Xianhui Wang,
  • Zhenyou Wang

摘要

The rapid growth of Internet of Things (IoT) devices and the deployment of unmanned aerial vehicles (UAVs) as aerial base stations (BS) introduce significant challenges in uplink random access for massive machine-type communication (mMTC) networks. This paper proposes a Q-learning-based random access scheme integrated with Sparse Code Multiple Access (SCMA) tailored for UAV-assisted IoT scenarios. By enabling devices to autonomously optimize time slot group selection and codebook allocation through Q-learning, the scheme enhances access success probability and throughput while satisfying practical system constraints. A customized reward function ensures stable learning convergence and efficient resource utilization. Simulation results demonstrate the effectiveness and robustness of the proposed approach in improving access performance under dense device deployments, validating its suitability for scalable and reliable uplink access control in UAV-enabled mMTC networks.