development of advanced segmentation-based ... ao final workshop, rome, 27-29 march 2012 project id:...

32
COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle reduction and texture restoration in high-resolution SAR imagery L. Alparone°, F. Argenti°, T. Bianchi°, A. Lapini°, B. Aiazzi*, S. Baronti*, M. Abbate + , C. D’Elia + , S. Ruscino + °Department of Electronics & Telecommunications, University of Florence, Florence, Italy *Institute of Applied Physics “Nello Carrara” (IFAC-CNR), Florence, Italy + DAEIMI, University of Cassino, Cassino (FR), Italy

Upload: phamtram

Post on 02-Dec-2018

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Development of advanced segmentation-based multiresolution methods for speckle reduction and texture restoration in high-resolution SAR imagery

L. Alparone°, F. Argenti°, T. Bianchi°, A. Lapini°, B. Aiazzi*, S. Baronti*,

M. Abbate+, C. D’Elia+, S. Ruscino+

°Department of Electronics & Telecommunications, University of Florence, Florence, Italy*Institute of Applied Physics “Nello Carrara” (IFAC-CNR), Florence, Italy

+DAEIMI, University of Cassino, Cassino (FR), Italy

Page 2: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Scenario and motivations Problem statement

• Undecimated Discrete Wavelet Transform (UDWT)• Bayesian estimation: PDF modeling in UDWT domain

Proposed method for SAR image despeckling in UDWT domain• MAP filtering with GG and L-G priors• Segmentation-based modeling and estimation

Results on COSMO-SkyMed SAR data- sensitiveness to speckle correlation (1-look and multi-look products)- sensitiveness to resampling of the data- sensitiveness to type of estimator (GG and L-G)

Quality assessment of despeckled images• Use of a novel feature to detect structural changes between two SAR images• Comparisons between the segmented GG-MAP filter and Gamma-MAP filters

Presentation Outline

Page 3: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Scenario and Motivations

• The all-weather acquisition capability of SAR systems, either spaceborne or not, is hampered by the presence of the noise peculiar of coherent systems named speckle.

• Speckle severely undermines the possibility of performing automated analysis in general, and temporal change analysis in particular.

• A preliminary processing of (detected) SAR images aimed at speckle reduction is beneficial for a number of applications but such a preprocessing should be carefully designed to avoid spoiling useful information:

• local mean of RCS;

• point targets;

• linear features;

• texture.

Page 4: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Problem Statement

• Under a perspective of statistical signal processing, despeckling aims at performing an estimation of the radar reflectivity, based on the available speckled image.

• Such an estimation may be approached as a Bayesian estimation as the conditional expectation of the noise-free reflectivity to the noisy SAR image

• minimum mean square error (MMSE) estimation (conditional mean),

• minimum mean absolute error (MMAE) estimation (conditional median),

• maximum a-posteriori probability (MAP) estimation (conditional mode).

• Under Gaussianity assumptions, all estimators yield identical solutions: linear MMSE (LMMSE) estimation or pseudo-Wiener filtering (for non stationary signals).

• The MAP approach, is generally more powerful, even though more crucial and computationally more complex.

Page 5: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Multiresolution Despeckling

• A promising approach to image denoising in general, and to despeckling in particular, consists of carrying out estimation in a transformed domain obtained via multiresolution analysis (MRA).

• The undecimated discrete wavelet transform (UDWT), a.k.a. stationary wavelet transform (SWT), exhibits the shift-invariance property and is particularly suitable for most of image processing tasks (e.g., denoising, fusion, etc.) with the exception of data compression.

• Following a trend established in the literature during the last decade, Bayesian estimation has been accomplished in the UDWT domain, thereby exploiting its scale-space varying structure.

Page 6: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Stationary Wavelet Transform 1/2

SWT

Equivalent filters of SWT

DWT

Page 7: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Stationary Wavelet Transform 2/2

DWT

SWT

Page 8: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Despeckling in UDWT Domain

Page 9: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Speckle Model (1 of 2)

Page 10: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Speckle Model (2 of 2)

Page 11: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Bayesian Estimators

Page 12: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Statistical Modeling in UDWT Domain (1 of 3)

Page 13: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Statistical Modeling in UDWT Domain (2 of 3)

Page 14: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Statistical Modeling in UDWT Domain (3 of 3)

Page 15: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Filters for G-G Model

Page 16: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Filters for L-G Model (1 of 2)

Page 17: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Filters for L-G Model (2 of 2)

Page 18: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Filters for GG-GG Model

Page 19: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Results with Simulated Images

Page 20: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

MAP Despeckling in SWT Domain (1 of 2)Argenti, Bianchi & Alparone, IEEE TIP, 2006

Conjecture: SWT coefficients obey to a Generalized Gaussian law with space-varying parameters

MAP equation for GG PDFGG parameters estimation:• Standard deviation: same as for ML estimation;• Shape factor: computed from 2nd- and 4th-order moments of empirical distributions of SWT coefficients.• SWT coefficients in MAP equation obtained by LTI filtering reflectivity and speckle; • moments computed from cumulants: cumulants of LTI-filtered process obtained by LTI filtering cumulants of

input.

Page 21: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

MAP Despeckling in SWT Domain (2 of 2)Bianchi, Argenti & Alparone, IEEE TGARS, 2008

The MAP solution in SWT domain has been specialised to SAR imagery in the following manner:

• Every SWT subband is segmented into statistically homogeneous segments and one shape factor of GG PDF is estimated for each segment (variance is estimated for each point, same as for LMMSE filtering).

• This solution allows to handle scene heterogeneity as imaged by SAR system.

• The concept of heterogeneity is crucial for high spatial resolution SAR: the circular Gaussian model of complex reflectivity may no longer hold when the resolution cell does not contain a large number of independent scatterers.

• Thus, the speckle model changes with the degree of texture.

• Point targets are preprocessed, i.e. detected in the spatial image and removed (clipped) before wavelet processing, to be restored in value after despeckling.

Page 22: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

TS-MRF Segmentation (1 of 2)

• Image segmentation has been found to be useful for MAP despeckling.

• Unlike the earlier work in which wavelet planes were individually segmented based on the energy of their coefficient, in this work, a segmentation map is calculated for the whole image and superimposed to all wavelet planes.

• Problem: image segmentation algorithms exploit image models of local homogeneity and SAR images are corrupted by speckle noise.

• Traditional image segmentation algorithms may be inadequate to SAR images.

•Information-Theoretic Heterogeneity Features [Aiazzi et al., IEEE TGARS, 2005] are calculated from the original SAR image.

• Such maps of features are segmented by using a tree-structured algorithm based on Markov random fields (TS-MRF) [C. D’Elia, G. Poggi and G. Scarpa, IEEE TIP, 2003].

Page 23: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Feature Map

TS-MRF Segmentation (2 of 2)

Segmentation Map

Page 24: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

CSK Stripmap 1-look 1024 x 1024 (from 1A-bal.)

Original: Measured ENL=0.91 GG-MAP-SEG: Measured ENL = 18

Page 25: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

CSK Stripmap 1-look 1024 x 1024 (from 1A-unb.)

Original: Measured ENL = 0.97 GG-MAP-SEG: Measured ENL = 100

Page 26: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

CSK Stripmap 4-look 512 x 512 (from 1A-bal.)

Original: Theoretically calculated ENL = 2.20 GG-MAP-SEG: Measured ENL = 85

Page 27: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

CSK Stripmap 4-look 512 x 512 (from 1A-unb.)

Original: Measured ENL = 3.10 GG-MAP-SEG: Measured ENL = 210

Page 28: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Effects of Resampling on Despeckling

GG-MAP-SEG of 4-look from 1A: ENL = 85 GG-MAP-SEG of 4-look from 1B: ENL = 75

Page 29: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Comparison of Estimators: GG-MAP-S vs. LG-MAP-SLG-MAP-SEG: ENL = 170 GG-MAP-SEG: ENL = 85

LG-MAP-SEG too aggressive on textureHOWEVER

LG-MAP 10 times faster than GG-MAP!

Original 4-L 300 x 512 from 1A-b data product

Page 30: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Comparisons w/ State-o-t-Art: 4-L, 512 x 512, 1A-b

Gamma-MAP filter (NEST implementation): ENL = 45 GG-MAP-SEG: ENL = 85

Page 31: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

Map of Feature Showing Filtering Inaccuracies

Gamma-MAP GG-MAP-S

Page 32: Development of advanced segmentation-based ... AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293 Development of advanced segmentation-based multiresolution methods for speckle

COSMO-SkyMed AO Final Workshop, Rome, 27-29 March 2012 Project ID: 2293

• A computational approach to despeckle SAR images based on segmented MAP filtering in UDWT domain.

• Optimization of the method on COSMO-SkyMed data products.• Multilooking mitigates the strong spatial correlation of speckle in single-look data• Influence of resampling on MAP filtering performances is little relevant.• Cost-benefits tradeoff of PDF models for MAP filtering (L-G 10 times faster than

GG: 9 s vs. 93 s for a 512 x 512 image and Matlab implementations).• The final version can switch different estimators (L-G-MAP, GG-MAP) according

to the degree of texture of individual segments.• Comparisons more than favorable with classical Gamma-MAP filter.• Developments of statistical methods to evaluate the quality of despeckling on true

SAR images without reference originals.• Blind whitening of SLC data to achieve uncorrelated 1-look intensity speckle.

Conclusions and Developments