HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisation

Deuser Fabian ; Habel Konrad ; Oswald Norbert

Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisation

Abstract

Cross-View Geo-Localisation is still a challenging task where additionalmodules, specific pre-processing or zooming strategies are necessary todetermine accurate positions of images. Since different views have differentgeometries, pre-processing like polar transformation helps to merge them.However, this results in distorted images which then have to be rectified.Adding hard negatives to the training batch could improve the overallperformance but with the default loss functions in geo-localisation it isdifficult to include them. In this article, we present a simplified buteffective architecture based on contrastive learning with symmetric InfoNCEloss that outperforms current state-of-the-art results. Our framework consistsof a narrow training pipeline that eliminates the need of using aggregationmodules, avoids further pre-processing steps and even increases thegeneralisation capability of the model to unknown regions. We introduce twotypes of sampling strategies for hard negatives. The first explicitly exploitsgeographically neighboring locations to provide a good starting point. Thesecond leverages the visual similarity between the image embeddings in order tomine hard negative samples. Our work shows excellent performance on commoncross-view datasets like CVUSA, CVACT, University-1652 and VIGOR. A comparisonbetween cross-area and same-area settings demonstrate the good generalisationcapability of our model.

Code Repositories

Skyy93/Sample4Geo
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
cross-view-geo-localisation-on-spagbolSample4Geo
Top-1: 50.80
drone-view-target-localization-on-university-1Sample4Geo
AP: 93.81
Recall@1: 92.65
image-based-localization-on-cvactSample4Geo
Recall@1: 90.81
Recall@1 (%): 98.77
Recall@10: 97.48
Recall@5: 96.74
image-based-localization-on-cvusa-1Sample4Geo
Recall@1: 98.68
Recall@10: 99.78
Recall@5: 99.68
Recall@top1%: 99.87
image-based-localization-on-vigor-cross-areaSample4Geo
Hit Rate: 69.87
Recall@1: 61.70
Recall@1%: 98.17
Recall@10: 88.00
Recall@5: 83.50
image-based-localization-on-vigor-same-areaSample4Geo
Hit Rate: 89.82
Recall@1: 77.86
Recall@1%: 99.61
Recall@10: 97.21
Recall@5: 95.66
visual-place-recognition-on-cv-citiesSample4Geo
Recall@1: 74.49
Recall@5: 84.07

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisation | Papers | HyperAI