Hybridization of deep and prototypical neural network for rare defect classification on aircraft fuselage images acquired by an unmanned aerial vehicle
METADATA ONLY
Loading...
Author / Producer
Date
2020-07
Publication Type
Journal Article
ETH Bibliography
yes
Citations
Altmetric
METADATA ONLY
Data
Rights / License
Abstract
To ease visual inspections of exterior aircraft fuselage, new technical approaches have been recently deployed. Automated unmanned aerial vehicles (UAVs) are now acquiring high-quality images of aircraft in order to perform offline analysis. At first, some acquisitions are annotated by human operators in order to provide a large dataset required to train machine learning methods, especially for critical defect detection. An intrinsic problem of this dataset is its extreme imbalance (i.e., there is an unequal distribution between classes). The rarest and most valuable samples represent few elements among thousands of annotated objects. Deep learning (DL)-only based approaches have proven to be very effective when a sufficient amount of data are available for each desired class, whereas few-shot learning (FSL)-dedicated methods (matching network, prototypical network, etc.) can learn from only few samples. In a previous work, those approaches were compared on our applicative case and it was demonstrated that combining DL model and prototypical neural network in a hybrid architecture improves the results. We extend this work by questioning the interface between models in such a hybrid architecture. We show that by carefully selecting the data from the well-represented class when using FSL techniques, it is possible to enhance the previously proposed solution. © 2020 SPIE and IS&T.
Permanent link
Publication status
published
External links
Editor
Book title
Journal / series
Volume
29 (4)
Pages / Article No.
41010
Publisher
SPIE
Event
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Deep learning; Few-shot learning; Prototypical neural network; Hybrid model; Defect detection; Visual inspection