HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization

Wang Tingyu ; Zheng Zhedong ; Yan Chenggang ; Zhang Jiyong ; Sun Yaoqi ; Zheng Bolun ; Yang Yi

Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization

Abstract

Cross-view geo-localization is to spot images of the same geographic targetfrom different platforms, e.g., drone-view cameras and satellites. It ischallenging in the large visual appearance changes caused by extreme viewpointvariations. Existing methods usually concentrate on mining the fine-grainedfeature of the geographic target in the image center, but underestimate thecontextual information in neighbor areas. In this work, we argue that neighborareas can be leveraged as auxiliary information, enriching discriminative cluesfor geolocalization. Specifically, we introduce a simple and effective deepneural network, called Local Pattern Network (LPN), to take advantage ofcontextual information in an end-to-end manner. Without using extra partestimators, LPN adopts a square-ring feature partition strategy, which providesthe attention according to the distance to the image center. It eases the partmatching and enables the part-wise representation learning. Owing to thesquare-ring partition design, the proposed LPN has good scalability to rotationvariations and achieves competitive results on three prevailing benchmarks,i.e., University-1652, CVUSA and CVACT. Besides, we also show the proposed LPNcan be easily embedded into other frameworks to further boost performance.

Code Repositories

wtyhub/LPN
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
drone-navigation-on-university-1652-1LPN
AP: 74.79
Recall@1: 86.45
drone-view-target-localization-on-university-1LPN
AP: 79.14
Recall@1: 75.93
image-based-localization-on-cvactLPN
Recall@1: 79.99
Recall@1 (%): 97.03
Recall@10: 92.56
Recall@5: 90.63
image-based-localization-on-cvusa-1LPN
Recall@1: 85.79
Recall@10: 96.98
Recall@5: 95.38
Recall@top1%: 99.41

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization | Papers | HyperAI