HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Enhancing crop segmentation in satellite image time-series with transformer networks

{A. U. Rehman Riccardo La Grassa M. Boschetti C. Loschiavo Nicola Landro Mattia Gatti Ignazio Gallo}

Abstract

Recent studies have shown that Convolutional Neural Networks (CNNs) achieve impressive results in crop segmentation of Satellite Image Time-Series (SITS). However, the emergence of transformer networks in various vision tasks raises the question of whether they can outperform CNNs in crop segmentation of SITS. This paper presents a revised version of the Transformer-based Swin UNETR model adapted specifically for crop segmentation of SITS. The proposed model demonstrates significant advancements, achieving a validation accuracy of 96.14% and a test accuracy of 95.26% on the Munich dataset, surpassing the previous best results of 93.55% for validation and 92.94% for the test. Additionally, the model’s performance on the Lombardia dataset is comparable to UNet3D and superior to FPN and DeepLabV3. Experiments of this study indicate that the model will likely achieve comparable or superior accuracy to CNNs while requiring significantly less training time. These findings highlight the potential of transformer-based architectures for crop segmentation in SITS, opening new avenues for remote sensing applications.

Benchmarks

BenchmarkMethodologyMetrics
semantic-segmentation-on-lombardia-sentinel-2UNet3D
Overall Accuracy: 80.77
semantic-segmentation-on-lombardia-sentinel-2DeepLabv3 3D
Overall Accuracy: 74.51
semantic-segmentation-on-lombardia-sentinel-2Swin UNETR
Overall Accuracy: 79.64
semantic-segmentation-on-lombardia-sentinel-23D FPN with NDVI Loss
Overall Accuracy: 77.23
unet-segmentation-on-munich-sentinel2-crop-1UNet3D
Overall Accuracy: 94.73
unet-segmentation-on-munich-sentinel2-crop-1Swin UNETR
Overall Accuracy: 95.26
unet-segmentation-on-munich-sentinel2-crop-1DeepLabv3 3D
Overall Accuracy: 85.98

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Enhancing crop segmentation in satellite image time-series with transformer networks | Papers | HyperAI