HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

LSKNet: A Foundation Lightweight Backbone for Remote Sensing

Yuxuan Li Xiang Li Yimian Dai Qibin Hou Li Liu Yongxiang Liu Ming-Ming Cheng Jian Yang

LSKNet: A Foundation Lightweight Backbone for Remote Sensing

Abstract

Remote sensing images pose distinct challenges for downstream tasks due to their inherent complexity. While a considerable amount of research has been dedicated to remote sensing classification, object detection and semantic segmentation, most of these studies have overlooked the valuable prior knowledge embedded within remote sensing scenarios. Such prior knowledge can be useful because remote sensing objects may be mistakenly recognized without referencing a sufficiently long-range context, which can vary for different objects. This paper considers these priors and proposes a lightweight Large Selective Kernel Network (LSKNet) backbone. LSKNet can dynamically adjust its large spatial receptive field to better model the ranging context of various objects in remote sensing scenarios. To our knowledge, large and selective kernel mechanisms have not been previously explored in remote sensing images. Without bells and whistles, our lightweight LSKNet sets new state-of-the-art scores on standard remote sensing classification, object detection and semantic segmentation benchmarks. Our comprehensive analysis further validated the significance of the identified priors and the effectiveness of LSKNet. The code is available at https://github.com/zcablii/LSKNet.

Code Repositories

zcablii/Large-Selective-Kernel-Network
pytorch
Mentioned in GitHub
zcablii/lsknet
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
change-detection-on-levir-cdLSKNet
F1: 92.27
F1-score: 92.27
IoU: 85.65
Precision: 93.34
Recall: 91.23
change-detection-on-s2lookingLSKNet-S
F1-Score: 67.52
IoU: 50.96
Precision: 71.90
Recall: 63.64
object-detection-in-aerial-images-on-dota-1LSKNet-T
mAP: 81.37%
object-detection-in-aerial-images-on-dota-1LSKNet-S*
mAP: 81.85%
object-detection-in-aerial-images-on-dota-1LSKNet-S
mAP: 81.64%
semantic-segmentation-on-isprs-potsdamLSKNet-S
Mean F1: 93.1
Mean IoU: 87.2
Overall Accuracy: 92.0
semantic-segmentation-on-isprs-vaihingenLSKNet-T
Average F1: 91.7
Category mIoU: 84.9
Overall Accuracy: 93.6
semantic-segmentation-on-isprs-vaihingenLSKNet-S
Average F1: 91.8
Category mIoU: 85.1
Overall Accuracy: 93.6
semantic-segmentation-on-uavidLSKNet-S
Mean IoU: 70.0
semantic-segmentation-on-uavidLSKNet-T
Mean IoU: 69.3

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
LSKNet: A Foundation Lightweight Backbone for Remote Sensing | Papers | HyperAI