A General Approach for the Automation of Hydraulic Excavator Arms Using Reinforcement Learning
OPEN ACCESS
Loading...
Author / Producer
Date
2022-04
Publication Type
Journal Article
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
This article presents a general approach to derive an end effector trajectory tracking controller for highly nonlinear hydraulic excavator arms. Rather than requiring an analytical model of the system, we use a neural network model that is trained based on measurements collected during operation of the machine. The data-driven model effectively represents the actuator dynamics including the cylinder-to-joint-space conversion. Requiring only the distances between the individual joints, a simulation is set up to train a control policy using reinforcement learning (RL). The policy outputs pilot stage control commands that can he directly applied to the machine without further tine-tuning. The proposed approach is implemented on a Menzi Muck M545, a 12 t hydraulic excavator, and tested in different task space trajectory tracking scenarios, with and without soil interaction. Compared to a commercial grading controller, which requires laborious hand-tuning by expert engineers, the learned controller shows higher tracking accuracy, indicating that the achieved performance is sufficient for the practical application on construction sites and that the proposed approach opens a new avenue for future machine automation.
Permanent link
Publication status
published
External links
Editor
Book title
Journal / series
Volume
7 (2)
Pages / Article No.
5679 - 5686
Publisher
IEEE
Event
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Robotics and automation in construction; reinforcement learning; autonomous excavator; sim-to-real
Organisational unit
09570 - Hutter, Marco / Hutter, Marco
02284 - NFS Digitale Fabrikation / NCCR Digital Fabrication