HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention

Vivien Sainte Fare Garnot Loic Landrieu Sebastien Giordano Nesrine Chehata

Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention

Abstract

Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of agricultural parcels is an issue of major political and economic importance. In this regard, hybrid convolutional-recurrent neural architectures have shown promising results for the automated classification of satellite image time series.We propose an alternative approach in which the convolutional layers are advantageously replaced with encoders operating on unordered sets of pixels to exploit the typically coarse resolution of publicly available satellite images. We also propose to extract temporal features using a bespoke neural architecture based on self-attention instead of recurrent networks. We demonstrate experimentally that our method not only outperforms previous state-of-the-art approaches in terms of precision, but also significantly decreases processing time and memory requirements. Lastly, we release a large open-access annotated dataset as a benchmark for future work on satellite image time series.

Code Repositories

VSainteuf/pytorch-psetae
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
time-series-classification-on-s2-agriPSE+TAE
mIoU: 50.9
oAcc: 94.2

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention | Papers | HyperAI