Contact-Rich Task Learning on an Articulated Soft Robot Arm Through Simulation
摘要
Traditional rigid robots face limitations in exploration during learning processes in dynamic and unknown environments where contact and impacts are common. Soft robots that leverage compliant materials, for example as part of variable stiffness actuators (VSAs), offer promising avenues for enhanced adaptability and safety. Deep Reinforcement Learning (RL), while proven to be a powerful tool, requires a lot of training data that is time-consuming to gather. This paper introduces a novel approach to simulating robots driven by antagonistic VSAs, as well as full-task learning with a soft robot arm in three environments with different contact types: path following (no contact), door opening (kinematic constraint), and surface wiping (continuous contact). We show that the tendon-driven robot can learn all three tasks, even if learning in a very low-level actuation space. The stretchable tendons enables it to perform relatively well on the contact-rich tasks. Further, using the proposed variable stiffness controller the robot is able to develop a stable behaviour in terms of forces applied to the environment. The results are promising for extending the approach to the physical robot.