[ieee 2012 7th iapr workshop on pattern recognition in remote sensing (prrs) - tsukuba science city,...

4
Despeckling Structural Loss(DSL):A New Metric for Measuring Structure- Preserving Capability of Despeckling Algorithms Xuezhi Yang, Li Jia, Yujie Wang, Yiming Tang School of Computer and Information, Hefei Universi of Technolo, Hefei, Anhui, China xzyang@hfut. edu. en Abstract In this paper, a new metric called despeckling structural 10ss(DSL) is proposed for performance assessment of despeckling algorithms with a focus on the preservation of structural information. By taking into account characteristics of the best and worst structure preservation in despeckling, the DSL metric examines the presence of image structures in ratio images by using local correlations between the ratio image and the noise-free reference image at edge points, leading an objective and quantitative measure of the structure-preserving capabili of despeckling algorithms. The DSL metric has been tested on despeckling results of a simulated SAR image using three pes of algorithms and ef ficien of the DSL has been demonstrated In comparison, the other five commonly used despeckling metrics fail to keep a consistency with the structural loss shown in despeckling results as well as ratio images. 1. Introduction Synthetic aperture radar (SAR) is a microwave remote sensing system with the distinct feature of imaging in all-day and all-weather conditions. The acquired SAR images are known to be corrupted by coherent speckle noise which forms an obstacle to human interpretation as well as automated infonnation extraction. To alleviate impacts of speckle noise, a large number of despeckling algorithms have been developed with focuses on speckle reduction in homogeneous regions, preservation of radiometric infonnation and preservation of structural infoation including edges and textures[l]. Performance of despeckling algorithms needs to be properly assessed according to the objectives of speckle reduction, which is necessary for the objective comparisons of algorithms. Since image structures are critical to SAR image interpretation, structure- preserving capability is the major conce in the assessment of despeckling algorithms. Various metrics have been designed for measuring despeckling perfonnance which include mean-square error (MSE) [2],[3] and its variations such as signal-to-mean-square error ratio (S/MSE)[4], and peak signal-to-noise ratio (PSNR)[5], edge coelations (EC)[4], Pratt's figure of merit (FOM)[5],[6], structural similarity (SSIM)[3]. These despeckling metrics primarily measure discrepancies or similarities between the despeckled image and the noise-ee reference image with respect to some image characteristics such as intensity, local variation and edge. However, changes of structural information by despeckling are not properly taken into account in defining the above metrics which cause inaccurate measure of structure-preserving capability of despeckling algorithms. Another way to assessing preservation of structural information is based on the ratio image of the original SAR image to the despeckled image. According to the multiplicative model of speckle noise, the ratio image should ideally contains the noise removed by the despeckling process while the presence of image structures indicates the corresponding loss in the despeckled results. For this reason, equivalent number of looks of ratio image(ENLR)[2],[3],[4]is adopted whose deviation om the nominal number of looks of the SAR image is considered as a measure of structure preservation. Although perfect despeckling corresponds to the ENLR with the nominal value, the degree of deviation may not uniquely indicate the actual loss of structural infonnation. Currently, visual inspection of structural information presented in ratio images is adopted as a more reliable alterative to the ENLR metric[2],[3], while which still has the

Upload: dinhthu

Post on 17-Mar-2017

213 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: [IEEE 2012 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS) - Tsukuba Science City, Japan (2012.11.11-2012.11.11)] 7th IAPR Workshop on Pattern Recognition in Remote

Despeckling Structural Loss(DSL):A New Metric for Measuring Structure­

Preserving Capability of Despeckling Algorithms

Xuezhi Yang, Li Jia, Yujie Wang, Yiming Tang School of Computer and Information, Hefei University of Technology, Hefei, Anhui, China

xzyang@hfut. edu. en

Abstract

In this paper, a new metric called despeckling

structural 10ss(DSL) is proposed for performance

assessment of despeckling algorithms with a focus on

the preservation of structural information. By taking

into account characteristics of the best and worst

structure preservation in despeckling, the DSL metric

examines the presence of image structures in ratio

images by using local correlations between the ratio

image and the noise-free reference image at edge

points, leading an objective and quantitative measure

of the structure-preserving capability of despeckling

algorithms. The DSL metric has been tested on

despeckling results of a simulated SAR image using

three types of algorithms and efficiency of the DSL has

been demonstrated. In comparison, the other five

commonly used despeckling metrics fail to keep a

consistency with the structural loss shown in

despeckling results as well as ratio images.

1. Introduction

Synthetic aperture radar (SAR) is a microwave

remote sensing system with the distinct feature of

imaging in all-day and all-weather conditions. The

acquired SAR images are known to be corrupted by

coherent speckle noise which forms an obstacle to

human interpretation as well as automated infonnation

extraction. To alleviate impacts of speckle noise, a

large number of despeckling algorithms have been

developed with focuses on speckle reduction in

homogeneous regions, preservation of radiometric

infonnation and preservation of structural information

including edges and textures[l].

Performance of despeckling algorithms needs to be

properly assessed according to the objectives of

speckle reduction, which is necessary for the objective

comparisons of algorithms. Since image structures are

critical to SAR image interpretation, structure­

preserving capability is the major concern in the

assessment of despeckling algorithms. Various metrics

have been designed for measuring despeckling

perfonnance which include mean-square error (MSE)

[2],[3] and its variations such as signal-to-mean-square

error ratio (S/MSE)[4], and peak signal-to-noise ratio

(PSNR)[5], edge correlations (EC)[4], Pratt's figure of

merit (FOM)[5],[6], structural similarity (SSIM)[3].

These despeckling metrics primarily measure

discrepancies or similarities between the despeckled

image and the noise-free reference image with respect

to some image characteristics such as intensity, local

variation and edge. However, changes of structural

information by despeckling are not properly taken into

account in defining the above metrics which cause

inaccurate measure of structure-preserving capability

of despeckling algorithms.

Another way to assessing preservation of structural

information is based on the ratio image of the original

SAR image to the despeckled image. According to the

multiplicative model of speckle noise, the ratio image

should ideally contains the noise removed by the

despeckling process while the presence of image

structures indicates the corresponding loss in the

despeckled results. For this reason, equivalent number

of looks of ratio image(ENLR)[2],[3],[4]is adopted

whose deviation from the nominal number of looks of

the SAR image is considered as a measure of structure

preservation. Although perfect despeckling

corresponds to the ENLR with the nominal value, the

degree of deviation may not uniquely indicate the

actual loss of structural infonnation. Currently, visual

inspection of structural information presented in ratio

images is adopted as a more reliable alterative to the

ENLR metric[2],[3], while which still has the

Page 2: [IEEE 2012 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS) - Tsukuba Science City, Japan (2012.11.11-2012.11.11)] 7th IAPR Workshop on Pattern Recognition in Remote

limitation of a subject and inaccurate assessment of

structure preservation.

In this paper, we propose a new metric called

despeckling structural loss (DSL) which takes into

account characteristics of the best and worst structure

preservation in despeckling. The DSL metric examines

the presence of structural information in ratio images

by using local correlations between the ratio image and

the noise-free reference image at edge points, which

offers an objective and quantitative measure of the

structure-preserving capability of despeckling

algorithms.

In the next section, definition of the DSL metric is

presented, followed by evaluations of the metrics in

Section III. Section IV concludes this paper.

2.The Proposed Metric-Despeckling

Structure Loss(DSL)

2.1. Ratio Image of SAR Image Despeckling

A SAR image corrupted by multiplicative speckle noise can be represented by the following model[I]:

y = XS, (1)

where y indicates the observed SAR image in

amplitude format, x denotes the magnitude of noise­

free image (backscattering coefficients) and s denotes

the speckle noise. Despeckling algorithms aim to

restore the noise-free image x from the SAR image y.

Based on the despeckled image denoted as u, a ratio

image r can be computed as

r = y/u (2)

As indicated by the multiplicative speckle noise

model (1), a perfect despeckling result in a ratio image

containing the speckle noise removed where the mean

of the ratio image should be close to unity and the

equivalent number of looks of the ratio image (ENLR)

should be close to the nominal number of looks of the

SAR image. On the other hand, structures found in the

ratio image are proportional to the loss of structural

information in the despeckled image.

2.2. The DSL Metric

We investigate two extreme cases of despeckling

with respect to structure preservation. One case named

Best Structure Preservation (BSP) perfectly restores the

noise-free image x and the ratio image is:

rBSp = y/u = y/x = s (3)

The other case named Worst Structure Preservation

(WSP) outputs a despeckled image of constant value

where image structures are completely removed. In

such a case, the ratio image becomes the original SAR

image:

rWSp =y/u=cy, (4)

where the constant c takes a value of lImean(y) if the

despeckled image is assumed to be the global mean of

uojBSPlWSP __ "::-' � E

Figure 1.Measurement of the DSL metric

the SAR image. According to the above defmitions, the

BSP case and the WSP case are determined by the

speckle noise and the SAR image respectively, both

independent of any despeckling algorithm.

From the BSP to the WSP, it is noted that contents

of the noise-free image x continuously increasing in the

ratio image. This motivates the development of a new

metric called DSL which characterizes the changing

structural information in the ratio image for measuring

the structure preserving capability of despeckling

algorithms. While the underlying noise-free image x is

normally unknown in real SAR images, the DSL

metric takes a full-reference approach as most existing

metrics by using simulated SAR images, which can be

generated by multiplying spatially uncorrelated speckle

noise to a noise-free reference image.

Measurement of the DSL metric, as illustrated in

Fig. 1, consists of the following steps:

1) Extract edge map E of the noise-free image x by

using the Canny edge detector [7] due to its simplicity

and efficiency (The two thresholds are 0.02 and 0.05,

and the width of the Gaussian filter is 0.1).

2) Compute the ratio image r of the despeckled image

to the SAR image.

3) At each edge point k of E, compute the correlation

between the reference image and the ratio image is:

where

CR(k) = 'f'(x-x,r-r)

(5) �'f'(x -X,X -x)· 'f'(r -r,r -r)

'f'(x,r)= I Xi' Ij , (6) ;EEnWin

x denotes the mean value in a local window Win,

whose size is set up as 11 x 11 in this work.

4) Compute the average correlation in the whole image:

CR = � ICR(k) (7) K k�1

Page 3: [IEEE 2012 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS) - Tsukuba Science City, Japan (2012.11.11-2012.11.11)] 7th IAPR Workshop on Pattern Recognition in Remote

where K is the number of edge points in E.

5) Compute the average correlation for the cases of

BSP and WSP, and obtain CRssp and CRwsp

respectively.

6) Compute the final DSL value by normalizing the

result CR with respect to CRBSP and CRwsp:

DSL = CR -CRBSP (8)

CRwsp -CRBSP

The DSL can be viewed as a combination of the EC,

the FOM as well as the ratio image. The edge map of

the noisy-free image is first detected as a representation

of the true image structures. Based on the edge map,

the DSL is computed as the correlation between the

noisy-free image and the ratio image, aiming at

detecting the presence of structures in the ratio image.

Ranging from zero to one, the DSL approaches zero

when the ratio image totally contains noise. The more

structures removed in the despeckling process or

equivalently presenting in the ratio image, the larger

the DSL value.

3. Testing and Results

3.1. Testing Setup

The DSL metric is tested on measuring the structure

preserving capability of several despeckling algorithms,

and compared with five commonly used despeckling

metrics including S/MSE, EC, FOM, SSIM and ENLR.

Three despeckling algorithms involved in the testing

are the enhanced Lee (EnLee) [1], the speckle reducing

anisotropic diffusion (SRAD) [6] and the nonlocal

means speckle reduction (NLMSR)[8]. A simulated SAR image is adopted for despeckling testing which is

generated by multiplying an aerial image (Fig. 2) with

spatially uncorrelated speckle noise in amplitude

format with the equivalent number of looks of 2.

Figure 2. An aerial Image

3.2. Testing Results and Discussions

The first testing is designed to validate the DSL

metric by comparing results of same type of

despeckling algorithm with varying degrees of

smoothing. Applying one despeckling algorithm on a

SAR image, larger smoothing degree means more loss

of structural information in the despeckling result.

Correspondingly, values of a metric desirable for

assessing structure-preserving capability should

monotonically change and be bounded in the range of

BSP and WSP. In this testing, each of the above three

despeckling algorithms is applied to the simulated SAR

image and generates 15 despeckled images with

increasing smoothing degrees by adjusting the

corresponding parameters of the algorithm. Fig. 3

illustrates the DSL values on despeckling images of the

EnLee (blue), the SRAD (black) and the NLMSR (pink)

respectively. For each type of despeckling, it can be

seen that the DSL value continuously goes up within

the range of BSP to WSP (i.e.,[O,I]) along with the

increase of smoothing degree. In comparison, the other

five metrics either do not change monotonically or

have values out of the range of BSP to WSP (Figures

of the results are not shown here due to the limited

space).

' .. ' ·· .. · .. · .. ' .. ·" · " · .. · .. ·· .. '·�N

......

-"'" . "'"

�:: . .... .. �� " r

I 1 , , s � , " , 10 I' U " 14 IS

Figure 3. The DSL for despeckling algorithms with

varying smoothing degrees

The second testing further validates the DSL metric

by comparing results from different types of

despeckling algorithms. Using the EnLee, the SRAD

and the NLMSR, four despeckling results marked by

boxes in Fig. 3 are picked out and shown in Fig. 4a to

4d which have increasing DSL values. The

corresponding ratio images are provided in Fig. 4e to

4h where more and more structures can be identified,

indicating a consistency with the DSL value. While as

shown in Table I, such a consistency is not followed in

using the other five metrics.

4. Conclusion

Preservation of structural information is of crucial

importance to despeckling algorithms while it still

cannot be properly assessed by various existing metrics.

The DSL metric proposed in this paper offers a new

means to measure structure preservation by

characterizing the loss of image structures as presented

in ratio images. Testing results have demonstrated the

usefulness of the DSL metric and its advantages over

Page 4: [IEEE 2012 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS) - Tsukuba Science City, Japan (2012.11.11-2012.11.11)] 7th IAPR Workshop on Pattern Recognition in Remote

existing metrics. Further work will focus on the

development of a new metric which combines the DSL

and the equivalent number of looks in homogeneous

regIOns for an overall assessment of despeckling

performance.

(a)NLMSR(DSL=0.427) (b)SRAD(DSL=0.467) (c) SRAD(DSL=0.517) (d) EnLee (DSL=0.600)

(e) ratio image of (a) (f) ratio image of (b) (g) ratio image of (c) (h) ratio image of (d)

Figure 4. Despeckling results using the NLMSR, the SRAD and the EnLee, with increasing DSL values

Table I. Various despeckling metrics measured on results shown in Fig.4a to 4d

Despeckling algorithms DSL S/MSE(dB)

NLMSR(Fig.4a) 0.427 13.8

SRAD(Fig.4b) 0.467 15.0

SRAD(Fig.4c) 0.517 14.8

EnLee(Fig.4d) 0.600 14.4

5. Acknowledgements

This work has been supported by the National

Natural Science Foundation of China (No. 41076120,

No. 60890075, No. 60672120, No. 61102154), Science

and Technological Fund of Anhui Province for

Outstanding Youth (10040606Y09), Provincial Natural

Science Research Project of Anhui Colleges (No.

KJ2011A242).

References

[I] C. Oliver and S. Quegan, Understanding Synthetic

Aperture Radar Images. Raleigh, NC: SciTech

Publishing, 2004.

[2] D. Gleich and M. Datcu, "Wavelet-based SAR image

despeckling and information extraction using particle

filter", IEEE Trans. Image Processing, vol. 18, no. 10, pp.

2167-2184,2009.

[3] M. Hebar, D. Gleich and Z. Cucej, "Autobinomial model

for SAR image despeckling and information extraction",

EC FOM SSIM ENLR

0.849 0.700 0.503 3.130

0.860 0.398 0.550 2.260

0.847 0.326 0.521 1.967

0.837 0.563 0.528 2.631

IEEE Trans. Geosci Remote Sensing, vol. 47, no. 8, pp.

2818-2835, 2009.

[4] A. Achim, E. E. Kuruoglu and J. Zerubia, "SAR image

filtering based on the heavy-tailed Rayleigh model",

iEEE Trans. Image Processing, vol. 15, no. 9, pp. 2686-

2693,2006.

[5] J. J. Ranjani and S. J. Thiruvengadam, "Dual-tree

complex wavelet transform based SAR despeckling

using interscale dependence", IEEE Trans. Geosci

Remote Sensing, vol. 48, no. 6, pp. 2723-2731, 2010.

[6] Y. Yu and S. T. Acton, "Speckle reducing anisotropic

diffusion", iEEE Trans. Image Processing, vol. 11, no.

11, pp.I260-I270, 2002.

[7] J. Canny, "A computational approach to edge

detection",lEEE Trans. Pattern Anal. Mach. intell. vol. 8,

no. 6, pp. 679-698, Nov., 1986.

[8] X. Yang and D. A. Clausi, "Structure-preserving speckle

reduction of SAR images using nonlocal means filters",

Proc. J 61h IEEE int'l Con! image Processing, pp. 2985-

2988,2009.

[9] A. Lopes, R. Touzi and E. Nezry, "Adaptive speckle

filters and scene heterogeneity", iEEE Trans. Geosci.

Remote Sensing, vol. 28, no. 6, pp. 992-1000, 1990.