Model-based Imitation Learning from Observation for input estimation in monitored systems


Loading...

Date

2025-02-15

Publication Type

Journal Article

ETH Bibliography

yes

Citations

Altmetric

Data

Abstract

In the context of structural and industrial asset monitoring and twinning, the estimation of unknown inputs – typically reflecting the loads acting onto a system – stands as a critical factor in ensuring both the safety and performance of engineered systems. This research introduces a novel approach for inferring such unknown inputs from observed outputs, focusing particularly on dynamical systems, whether characterized by known or learned dynamics. Our proposed approach is situated within the framework of Imitation Learning from Observation (ILfO), which is here recast in the context of dynamical systems’ estimation. Our primary objective is to infer estimates of input signals on the basis of real-world measured outputs. The problem is formulated as a Partially Observable Markov Decision Process (POMDP), and we address it by utilizing established planning algorithms specifically tailored for ILfO applications. To address the POMDP, we harness the effectiveness and robustness of the cross-entropy method. We first verify the efficacy of the proposed approach on simulated case studies involving dynamical systems possessing well-defined dynamics. The proposed method is further validated on a practical scenario involving experimental data from a scaled wind turbine blade, leveraging dynamics learned through the Neural Extended Kalman Filter (Neural EKF) technique; an approach which leverages deep learning for inferring the dynamics of a system when this is imprecisely known. These examples demonstrate the flexibility of the proposed approach for use with systems featuring different degrees of prescribed dynamics.

Publication status

published

Editor

Book title

Volume

225

Pages / Article No.

112233

Publisher

Elsevier

Event

Edition / version

Methods

Software

Geographic location

Date collected

Date created

Subject

Input estimation; Imitation learning; Partially observable Markov decision process; System invertibility; Reinforcement learning; Model predictive control; Cross-entropy method; Dynamics modeling

Organisational unit

03890 - Chatzi, Eleni / Chatzi, Eleni check_circle
02605 - Institut für Baustatik u. Konstruktion / Institute of Structural Engineering

Notes

Funding

Related publications and datasets