Real-time Onboard Visual-Inertial State Estimation and Self-Calibration of MAVs in Unknown Environments

Open access
Date
2012Type
- Conference Paper
ETH Bibliography
yes
Altmetrics
Abstract
The combination of visual and inertial sensors has proved to be very popular in robot navigation and, in particular, Micro Aerial Vehicle (MAV) navigation due the flexibility in weight, power consumption and low cost it offers. At the same time, coping with the big latency between inertial and visual measurements and processing images in real-time impose great research challenges. Most modern MAV navigation systems avoid to explicitly tackle this by employing a ground station for off-board processing. In this paper, we propose a navigation algorithm for MAVs equipped with a single camera and an Inertial Measurement Unit (IMU) which is able to run onboard and in real-time. The main focus here is on the proposed speed-estimation module which converts the camera into a metric body-speed sensor using IMU data within an EKF framework. We show how this module can be used for full self-calibration of the sensor suite in real-time. The module is then used both during initialization and as a fall-back solution at tracking failures of a keyframe-based VSLAM module. The latter is based on an existing high-performance algorithm, extended such that it achieves scalable 6DoF pose estimation at constant complexity. Fast onboard speed control is ensured by sole reliance on the optical flow of at least two features in two consecutive camera frames and the corresponding IMU readings. Our nonlinear observability analysis and our real experiments demonstrate that this approach can be used to control a MAV in speed, while we also show results of operation at 40Hz on an onboard Atom computer 1.6 GHz. Show more
Permanent link
https://doi.org/10.3929/ethz-a-010023094Publication status
publishedExternal links
Book title
2012 IEEE International Conference on Robotics and AutomationPages / Article No.
Publisher
IEEEEvent
Organisational unit
03737 - Siegwart, Roland Y. / Siegwart, Roland Y.
09559 - Chli, Margarita (ehemalig) / Chli, Margarita (former)
More
Show all metadata
ETH Bibliography
yes
Altmetrics