Command Palette
Search for a command to run...
Enhancing crop segmentation in satellite image time-series with transformer networks
{A. U. Rehman Riccardo La Grassa M. Boschetti C. Loschiavo Nicola Landro Mattia Gatti Ignazio Gallo}
Abstract
Recent studies have shown that Convolutional Neural Networks (CNNs) achieve impressive results in crop segmentation of Satellite Image Time-Series (SITS). However, the emergence of transformer networks in various vision tasks raises the question of whether they can outperform CNNs in crop segmentation of SITS. This paper presents a revised version of the Transformer-based Swin UNETR model adapted specifically for crop segmentation of SITS. The proposed model demonstrates significant advancements, achieving a validation accuracy of 96.14% and a test accuracy of 95.26% on the Munich dataset, surpassing the previous best results of 93.55% for validation and 92.94% for the test. Additionally, the model’s performance on the Lombardia dataset is comparable to UNet3D and superior to FPN and DeepLabV3. Experiments of this study indicate that the model will likely achieve comparable or superior accuracy to CNNs while requiring significantly less training time. These findings highlight the potential of transformer-based architectures for crop segmentation in SITS, opening new avenues for remote sensing applications.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| semantic-segmentation-on-lombardia-sentinel-2 | UNet3D | Overall Accuracy: 80.77 |
| semantic-segmentation-on-lombardia-sentinel-2 | DeepLabv3 3D | Overall Accuracy: 74.51 |
| semantic-segmentation-on-lombardia-sentinel-2 | Swin UNETR | Overall Accuracy: 79.64 |
| semantic-segmentation-on-lombardia-sentinel-2 | 3D FPN with NDVI Loss | Overall Accuracy: 77.23 |
| unet-segmentation-on-munich-sentinel2-crop-1 | UNet3D | Overall Accuracy: 94.73 |
| unet-segmentation-on-munich-sentinel2-crop-1 | Swin UNETR | Overall Accuracy: 95.26 |
| unet-segmentation-on-munich-sentinel2-crop-1 | DeepLabv3 3D | Overall Accuracy: 85.98 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.