Publication

Back to overview

Decision Fusion with Multiple Spatial Supports by Conditional Random Fields

Type of publication Peer-reviewed
Publikationsform Original article (peer-reviewed)
Author Tuia Devis, Volpi Michele, Volpi Michele, Moser Gabriele,
Project Multimodal machine learning for remote sensing information fusion
Show all

Original article (peer-reviewed)

Journal IEEE Transactions on Geoscience and Remote Sensing
Volume (Issue) 56(6)
Page(s) 3277 - 3289
Title of proceedings IEEE Transactions on Geoscience and Remote Sensing
DOI 10.1109/tgrs.2018.2797316

Open Access

URL https://arxiv.org/abs/1808.08024
Type of Open Access Repository (Green Open Access)

Abstract

© 1980-2012 IEEE. Classification of remotely sensed images into land cover or land use is highly dependent on geographical information at least at two levels. First, land cover classes are observed in a spatially smooth domain separated by sharp region boundaries. Second, land classes and observation scale are also tightly intertwined: they tend to be consistent within areas of homogeneous appearance, or regions, in the sense that all pixels within a roof should be classified as roof, independently on the spatial support used for the classification. In this paper, we follow these two observations and encode them as priors in an energy minimization framework based on conditional random fields (CRFs), where classification results obtained at pixel and region levels are probabilistically fused. The aim is to enforce the final maps to be consistent not only in their own spatial supports (pixel and region) but also across supports, i.e., by getting the predictions on the pixel lattice and on the set of regions to agree. To this end, we define an energy function with three terms: 1) a data term for the individual elements in each support (support-specific nodes); 2) spatial regularization terms in a neighborhood for each of the supports (support-specific edges); and 3) a regularization term between individual pixels and the region containing each of them (intersupports edges). We utilize these priors in a unified energy minimization problem that can be optimized by standard solvers. The proposed 2LCRF model consists of a CRF defined over a bipartite graph, i.e., two interconnected layers within a single graph accounting for interlattice connections. 2LCRF is tested on two very high-resolution data sets involving submetric satellite and subdecimeter aerial data. In all cases, 2LCRF improves the result obtained by the independent base model (either random forests or convolutional neural networks) and by standard CRF models enforcing smoothness in the spatial domain.
-