Statewide Visual Geolocalization in the Wild

This work presents a method that is able to predict the geolocation of a street-view photo taken in the wild within a state-sized search region by matching it against a database of aerial reference imagery. We partition the search region into geographical cells and train a model to map cells and corresponding photos into a joint embedding space that is used to perform retrieval at test time. The model utilizes aerial images for each cell at multiple levels-of-detail to provide sufficient context for photos with limited field of view. We propose a novel layout of the search region with consistent cell resolutions that allows scaling to large geographical regions. Experiments demonstrate that the method successfully localizes 60.6% of all non-panoramic street-view photos uploaded to the crowd-sourcing platform Mapillary in the state of Massachusetts to within 50m of their ground-truth location. Source code is available at \url{https://github.com/REMOVEDFORREVIEW}.