Abstract
Underactuation can enable low-cost, light-weight robotics. However, their design is challenging. While classical engineering intuition often leads to reasonable hardware and control choices that ensure basic functionality, the resulting performance is usually low. In contrast, purely data-driven coevolution of
ardware and software conventionally needs high computational effort to deliver meaningful results. We propose to leverage the advantages of both approaches by using classical intuitive controllers as proxies. As an example, we consider “Fizzy,” an underactuated robotic ball that leverages a unique single motor onfiguration in combination with dynamic imbalance for movement. In a first optimization, an intuitive Virtual Model Control (VMC) proxy serves to quickly evaluate various design parameters like motor mass and axle positioning for a Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The optimized configurations then serve as a foundation for training more sophisticated deep reinforcement learning (DRL) controllers. Our methodology underscores the potential of integrating intuitive proxies with evolutionary algorithms to enhance the performance and efficiency of underactuated robotic systems, paving the way for more adaptable and cost-effective robotic designs.
ardware and software conventionally needs high computational effort to deliver meaningful results. We propose to leverage the advantages of both approaches by using classical intuitive controllers as proxies. As an example, we consider “Fizzy,” an underactuated robotic ball that leverages a unique single motor onfiguration in combination with dynamic imbalance for movement. In a first optimization, an intuitive Virtual Model Control (VMC) proxy serves to quickly evaluate various design parameters like motor mass and axle positioning for a Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The optimized configurations then serve as a foundation for training more sophisticated deep reinforcement learning (DRL) controllers. Our methodology underscores the potential of integrating intuitive proxies with evolutionary algorithms to enhance the performance and efficiency of underactuated robotic systems, paving the way for more adaptable and cost-effective robotic designs.
Original language | English |
---|---|
Title of host publication | Workshop on Embodiment-Aware Robot Learning |
Subtitle of host publication | EARL 2024 |
Number of pages | 7 |
Publication status | Published - Jun 2024 |
Event | Workshop on Embodiment-Aware Robot Learning @ RSS 24 - Delft, Netherlands Duration: 15 Jul 2024 → 19 Jul 2024 https://sites.google.com/view/wearl |
Workshop
Workshop | Workshop on Embodiment-Aware Robot Learning @ RSS 24 |
---|---|
Country/Territory | Netherlands |
City | Delft |
Period | 15/07/24 → 19/07/24 |
Internet address |
Keywords
- Deep reinforcement learning
- evolutionary robotics
- intuitive engineering
- underactuated robotics
- virtual model control
- mujoco
- evolutionary optimization