JCJC SIMI 2 - JCJC - SIMI 2 - Science informatique et applications

Spatio-Temporal Analysis by Recognition within Complex Images for Remote Sensing of Environment – ASTERIX

Irreducible algorithms for satellite and aerial image mining and analysis

The ASTERIX project aims to contribute to basic research in computer science and its applications in the remote sensing of environment. Environment persevering policies still rely on tools with limited functionalities. Extracting landscape patterns from advanced image analysis methods will bring an additional source of information to help understanding the observed changes.

How to face Earth Observation data volume and complexity?

Following the growth of multisource data with high spatial, spectral, and temporal resolutions, the problem of complex image information mining in remote sensing of environment becomes a great challenge, with many potential applications raising. However, there is no or only a few methodological frameworks for dealing with data with multiple spatial and temporal scales. <br />The goal of the project is to bring new methods, algorithms, software in the field of image analysis and machine learning to address challenges related to data complexity: high dimensionality, heterogeneity, volume and spatial-temporal behavior of images. <br />Besides methodological achievements supporting the development of the state-of-the-art in image processing and machine learning, expected results from the ASTERIX project consist in a set of concrete solutions to crucial problems in remote sensing of environment, and specifically for coastal and mountains environments.

The ASTERIX project led to significant developments of several recent paradigms in data analytics and processing. Morphological hierarchies provide a framework tailored for fast remote sensing image analysis, on which can be applied kernel-based learning methods. Gaussian mixture models allows us to select relevant features to better represent complex data. Combining segmentation or classification results by relying on their uncertainty brings solutions for multi-source data. Non-negative matrix factorization methods can be employed in manifold learning for solving problems such as feature selection, anomaly detection, classification or spectral unmixing. Learning of time series can be obtained with active methods or bag-of-words approaches, and their reconstruction achieved with data assimilation techniques. Optimal transport provides an adequate framework for domain adaptation, while dimension reduction can lead to anomaly detection.

The ASTERIX project contributed to state-of-the-art progress in data science and its applications to Earth observation, with better methods in terms of results accuracy and/or (memory and computation) resource consumption, as well as the ability to process complex data still underexploited. In the context of new Earth Observation programs such as Sentinel, the targeted applications are numerous and various: land cover and land use mapping, biomass estimation, urban monitoring, etc. These applications will be further fostered by the Kermap start-up.

During this project, the deep learning paradigm widely spreads in machine learning, computer vision but also remote sensing. Far from overcoming the developments made in the ASTERIX project, the proliferation of deep learning calls for a coupling with other paradigms that have been mastered by the consortium during the project (e.g. hierarchical representations, optimal transport, time series analysis, etc.). In this context, the ASTERIX partners have recently engaged in various projects aiming to explore such an interface between different paradigms. While deep learning allows some significant improvements in recognition tasks in remote sensing, it still faces many challenges such as the data complexity, the need for training data, or the simplicity of tasks considered until now. Addressing such challenges is the future step of the works initiated in the ASTERIX project.

The ASTERIX project led to numerous international publications, with 21 papers in journals and 32 communications. Its results have been disseminated in several communities: machine learning (1 paper in Machine Learning journal and 4 in ECML-PKDD), pattern

Following the growth of multisource data with high spatial, spectral, and temporal resolutions, the problem of complex image information mining in remote sensing of environment becomes a great challenge, with many potential applications raising. However, there is no or only a few methodological frameworks for dealing with data with multiple spatial and temporal scales: recognition methods are most often straight applications of standard classification and modelisation methods. Besides, dealing with spatial and temporal neighborhood, with various kinds of data, is expected to improve significantly resulting performances.

The goal of the ASTERIX project (Spatio-Temporal Analysis by Recognition within Complex Images for Remote Sensing of Environment) and its originality is to bring new methods, algorithms, softwares in the field of image analysis and machine learning in order to support recognition within complex image, by explicitly dealing with the specificity of remote sensing complex images. In this context, main challenges are related to high dimensionality, heterogeneity, volume and spatio-temporal behaviour of images.

Besides methodological achievements supporting the development of the state-of-the-art in image processing and machine learning in the context of recognition within complex images, expected results from the ASTERIX project consist in a set of concrete solutions to crucial problems in remote sensing of environment, and especially in two environment: coastal and montains. More precisely, applications considered are related to the dynamic of environmental objects which help to understand coastal evolution, the dynamic of ash tree colonization in an agricultural mountain landscape, and the dynamic of geological process.

Project coordinator

Monsieur Sébastien Lefèvre (Institut de Recherche en Informatique et Systèmes Aléatoires)

The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.

Partner

IRISA Institut de Recherche en Informatique et Systèmes Aléatoires

Help of the ANR 275,979 euros
Beginning and duration of the scientific project: September 2013 - 48 Months

Useful links