Scholarlink

<p>For the first time in model-free control, the real-time swing up and balancing task of a quadruple inverted pendulum (QIP) is successfully performed through reinforcement learning (RL) in a sample-efficient, data-driven manner. As a full state-feedback closed-loop form, the policy network designed in this paper can achieve the control objective of efficiently swinging up and balancing a QIP even without any pre-computed reference trajectories and any mathematical models. To do so, this work first defines the Markov decision process (MDP) for QIP control and then applies a state-of-the-art off-policy RL algorithm, truncated quantile critics (TQC), to accomplish the control objective by using the probabilistic distribution of Q-values. For high sample-efficiency, virtual experience replay (VER) is used to leverage the geometrically symmetric structure and thereby reduce the learning time. The proposed demonstration shows that the complex QIP control problem, difficult-to-solve through classical model-based approaches, can be solved only from measured data without accurate mathematical model derivation and stability-guaranteed control design.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Reinforcement Learning to Achieve Real-time Control of a Quadruple Inverted Pendulum

  • 期刊论文

  • 发表日期：

    2025年9月9日

查看全文
  • Yookyung Oh,
  • Taegun Lee,
  • Sanghyun Ryoo,
  • Kyoung Chul Koh,
  • Soohee Han,
  • Young Sam Lee

摘要

For the first time in model-free control, the real-time swing up and balancing task of a quadruple inverted pendulum (QIP) is successfully performed through reinforcement learning (RL) in a sample-efficient, data-driven manner. As a full state-feedback closed-loop form, the policy network designed in this paper can achieve the control objective of efficiently swinging up and balancing a QIP even without any pre-computed reference trajectories and any mathematical models. To do so, this work first defines the Markov decision process (MDP) for QIP control and then applies a state-of-the-art off-policy RL algorithm, truncated quantile critics (TQC), to accomplish the control objective by using the probabilistic distribution of Q-values. For high sample-efficiency, virtual experience replay (VER) is used to leverage the geometrically symmetric structure and thereby reduce the learning time. The proposed demonstration shows that the complex QIP control problem, difficult-to-solve through classical model-based approaches, can be solved only from measured data without accurate mathematical model derivation and stability-guaranteed control design.