Command Palette
Search for a command to run...
DeepIndices: Remote Sensing Indices Based on Approximation of Functions through Deep-Learning, Application to Uncalibrated Vegetation Images
{Gawain Jones Christelle Gée Jean-Noël Paoli Jehan-Antoine Vayssade}
Abstract
The form of a remote sensing index is generally empirically defined, whether by choosing specific reflectance bands, equation forms or its coefficients. These spectral indices are used as preprocessing stage before object detection/classification. But no study seems to search for the best form through function approximation in order to optimize the classification and/or segmentation. The objective of this study is to develop a method to find the optimal index, using a statistical approach by gradient descent on different forms of generic equations. From six wavebands images, five equations have been tested, namely: linear, linear ratio, polynomial, universal function approximator and dense morphological. Few techniques in signal processing and image analysis are also deployed within a deep-learning framework. Performances of standard indices and DeepIndices were evaluated using two metrics, the dice (similar to f1-score) and the mean intersection over union (mIoU) scores. The study focuses on a specific multispectral camera used in near-field acquisition of soil and vegetation surfaces. These DeepIndices are built and compared to 89 common vegetation indices using the same vegetation dataset and metrics. As an illustration the most used index for vegetation, NDVI (Normalized Difference Vegetation Indices) offers a mIoU score of 63.98% whereas our best models gives an analytic solution to reconstruct an index with a mIoU of 82.19%. This difference is significant enough to improve the segmentation and robustness of the index from various external factors, as well as the shape of detected elements.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 2d-semantic-segmentation-on-deep-indices | Soil Adjusted Vegetation Index | mIoU: 67.28 |
| 2d-semantic-segmentation-on-deep-indices | Modified Chlorophyll Absorption In Reflectance Index 1 | mIoU: 73.68 |
| 2d-semantic-segmentation-on-deep-indices | 5x5 universal-function + ibf + sprb | mIoU: 80.63 |
| 2d-semantic-segmentation-on-deep-indices | 7x7 linear + ibf+sprb | mIoU: 81.49 |
| 2d-semantic-segmentation-on-deep-indices | 5x5 linear-ratio + ibf + sprb | mIoU: 80.08 |
| 2d-semantic-segmentation-on-deep-indices | 7x7 dense-morphological + ibf + sprb | mIoU: 82.19 |
| 2d-semantic-segmentation-on-deep-indices | Global Environment Monitoring Index | mIoU: 65.04 |
| 2d-semantic-segmentation-on-deep-indices | 3x3 dense-morphological + ibf + sprb | mIoU: 80.29 |
| 2d-semantic-segmentation-on-deep-indices | Adjusted Transformed Soil Adjusted VI | mIoU: 64.96 |
| 2d-semantic-segmentation-on-deep-indices | 5x5 polynomial + ibf + sprb | mIoU: 80.67 |
| 2d-semantic-segmentation-on-deep-indices | 1x1 polynomial + ibf | mIoU: 80.03 |
| 2d-semantic-segmentation-on-deep-indices | 7x7 polynomial + ibf + sprb | mIoU: 81.21 |
| 2d-semantic-segmentation-on-deep-indices | NDVI | mIoU: 63.98 |
| 2d-semantic-segmentation-on-deep-indices | Enhanced Vegetation Index 3 | mIoU: 65.05 |
| 2d-semantic-segmentation-on-deep-indices | 3x3 universal-function + ibf + sprb | mIoU: 81.08 |
| 2d-semantic-segmentation-on-deep-indices | 7x7 universal-function + ibf + sprb | mIoU: 80.36 |
| 2d-semantic-segmentation-on-deep-indices | Soil And Atmospherically Resistant VI 3 | mIoU: 65.86 |
| 2d-semantic-segmentation-on-deep-indices | Modified Triangular Vegetation Index 1 | mIoU: 73.71 |
| 2d-semantic-segmentation-on-deep-indices | 1x1 universal-function + ibf + sprb | mIoU: 80.15 |
| 2d-semantic-segmentation-on-deep-indices | Enhanced Vegetation Index 2 | mIoU: 67.94 |
| 2d-semantic-segmentation-on-deep-indices | 7x7 linear-ratio + ibf + sprb | mIoU: 81.35 |
| 2d-semantic-segmentation-on-deep-indices | 5x5 dense-morphological + ibf + sprb | mIoU: 81.92 |
| 2d-semantic-segmentation-on-deep-indices | 1x1 dense-morphological + ibf + sprb | mIoU: 80.00 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.