Command Palette
Search for a command to run...
Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization
Wang Tingyu ; Zheng Zhedong ; Yan Chenggang ; Zhang Jiyong ; Sun Yaoqi ; Zheng Bolun ; Yang Yi

Abstract
Cross-view geo-localization is to spot images of the same geographic targetfrom different platforms, e.g., drone-view cameras and satellites. It ischallenging in the large visual appearance changes caused by extreme viewpointvariations. Existing methods usually concentrate on mining the fine-grainedfeature of the geographic target in the image center, but underestimate thecontextual information in neighbor areas. In this work, we argue that neighborareas can be leveraged as auxiliary information, enriching discriminative cluesfor geolocalization. Specifically, we introduce a simple and effective deepneural network, called Local Pattern Network (LPN), to take advantage ofcontextual information in an end-to-end manner. Without using extra partestimators, LPN adopts a square-ring feature partition strategy, which providesthe attention according to the distance to the image center. It eases the partmatching and enables the part-wise representation learning. Owing to thesquare-ring partition design, the proposed LPN has good scalability to rotationvariations and achieves competitive results on three prevailing benchmarks,i.e., University-1652, CVUSA and CVACT. Besides, we also show the proposed LPNcan be easily embedded into other frameworks to further boost performance.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| drone-navigation-on-university-1652-1 | LPN | AP: 74.79 Recall@1: 86.45 |
| drone-view-target-localization-on-university-1 | LPN | AP: 79.14 Recall@1: 75.93 |
| image-based-localization-on-cvact | LPN | Recall@1: 79.99 Recall@1 (%): 97.03 Recall@10: 92.56 Recall@5: 90.63 |
| image-based-localization-on-cvusa-1 | LPN | Recall@1: 85.79 Recall@10: 96.98 Recall@5: 95.38 Recall@top1%: 99.41 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.