Image localization in satellite imagery with feature-based indexing

Abstract

This paper presents a method to index ortho-map databases with image-based features and search a map database for regions that matchquery images of unknown scales and rotations. The proposed method uses image-based features to index the 2D map locations. Imagefeature extractors normally generate features with location, orientation, shape, and a descriptor for normalized image patch. In a mapdatabase, the geographical location, orientation and shape of the image features can be recovered with a reasonable local planarityassumptions. The paper makes use of a visual word based recognition scheme and extends it by adding geographical dimensions to thevisual words and use them to index 2D locations in a map grid.An indexing-friendly scoring system is defined to measure the similarityof query and database images which represent unit tiles of the complete map. The implemented scoring algorithm can efficiently givethe matching scores between a query image and all possible database images. Upon searching a new approximately orthogonal image, aset of scaling and rotations are first selected, and the visual words are transformed and matched against the database. The best locationsalong with scales and rotations are determined from the query results of the different set of transformed visual words. Experimentsshow a high success rate and high speed in searching map databases for aerial images from different datasets.