a w con...a c epte d for the sp e cic al issue of the embs magazine entitle d "wavelets in me...

44

Upload: others

Post on 24-Feb-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Accepted for the Specical Issue of the EMBS Magazineentitled "Wavelets in Medicine," Guest Editor Metin Akay.Wavelets for Contrast Enhancementof Digital MammographyAndrew Laine, Jian Fan and Wuhai YangDepartment of Computer and Information ScienceComputer Science and Engineering Builiding, Room 301University of Florida, Gainesville, FL 32611Please send correspondence to: Andrew Laine, Assistant ProfessorE-mail: [email protected]: (904) 392-1239

Page 2: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Breast cancer currently accounts for 32% of cancer incidence and 18% of cancer mortality forwomen in the United States. There were 182,000 new cases of breast cancer in the United Statesin 1993 and 46,000 deaths. Five year survival rates are generally very high (93%) for breast cancerstaged as being localized, falling to 72% for regional disease and only 18% for distant disease [1].The early detection of breast cancer is clearly a key ingredient of any strategy designed to reducebreast cancer mortality.Despite advances in resolution and �lm contrast, check screen/�lm mammography remains adiagnostic imaging modality where image interpretation is very di�cult. Breast radiographs aregenerally examined for the presence of malignant masses and indirect signs of malignancy such asthe presence of microcalci�cations and skin thickening. Unfortunately, it is unlikely that majorimprovements in imaging performance will be achieved by technical advances in screen/�lm radiog-raphy alone. It has been suggested that as normally viewed, mammograms display only about 3% ofthe information they detect! [4]. The major reason for poor visualization of small malignant massesis the minor di�erence in x-ray attenuation between normal glandular tissues and malignant disease[2]. This fact makes the detection of small malignancies problematical, especially in younger womenwho have denser breast tissue. Although calci�cations have high inherent attenuation properties,their small size also results in a low subject contrast [3]. As a result, the visibility of small tumors,and any associated microcalci�cations, will always be a problem in mammography as it is currentlyperformed using analog �lm.Digital image processing techniques have been applied previously to mammography. The focusof past investigations has been to enhance mammographic features while reducing the enhancementof noise. Gordon and Rangayyan [5] used adaptive neighborhood image processing to enhancethe contrast of features relevant to mammography. This method enhanced the contrast of mam-mographic features as well as noise and digitization e�ects. Dhawan et al. [6, 7, 8] have madesigni�cant contributions towards solving problems encountered in mammographic image enhance-ment. They developed an adaptive neighborhood-based image processing technique that utilizedlow-level analysis and knowledge about a desired feature in the design of a contrast enhancement1

Page 3: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

function to improve the contrast of speci�c features. Recently, Tahoces et al. [9] developed amethod for the enhancement of chest and breast radiographs by automatic spatial �ltering. Intheir method, they used a linear combination of an original image and two smoothed images. Theprocess was completed by nonlinear contrast stretching. Thus spatial �ltering for enhanced edgeswas accomplished while minimally amplifying noise.Brzakovic et. al [10] developed an automated system for the detection and classi�cation ofparticular types of tumors in digitized mammograms. Their system identi�ed regions correspondingto possible tumors by multiscale image processing based on fuzzy pyramid linking. Regions wereclassi�ed by means of deterministic or Bayes classi�er and several metrics. They concluded thattheir system was very useful in detecting regions that need further analysis, but was somewhat lessreliable in recognition.Chan et. al [11, 12] investigated the application of computer-based methods for the detectionof microcalci�cations in digital mammograms. Their system was based on a di�erence-image tech-nique in which a signal-suppressed image was subtracted from a signal-enhanced image to removethe background in a mammogram. Signal-extraction techniques adapted to the known physical char-acteristics of microcalci�cations were used to isolate them from the remaining noise background.They found that their method could achieve a true-positive cluster detection rate of approximately80% at a false-positive detection rate of one cluster per image.In an earlier study related to this paper, computer simulated images were used to optimizedmultiscale wavelet based processing techniques [13]. Mathematical phantom images contained agaussian-shaped signal in half of the regions and included several levels of random noise. Signalintensity and noise levels were varied to determine a detection threshold contrast-to-noise ratio(CNR). An index of the ratio of output to input contrast to noise ratios was then used to optimizedwavelet based image processing algorithms. Computed CNRs were found to correlate well withsignal detection by human observers in both the original and processed images.Our approach to feature analysis and contrast enhancement is motivated in part by recentlydiscovered biological mechanisms of the human visual system [14]. Both multi-orientation and2

Page 4: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

multiresolution are known features of the human visual system. Speci�cally, there exist corticalneurons which respond speci�cally to stimuli within certain orientations and frequencies. In thispaper we exploit the orientation and frequency selectivity of multiscale wavelet transforms to makemammographic features more obvious through localized contrast gain.This paper is organized into two parts. In the �rst part we present a mathematical foundationfor an approach to accomplish image contrast enhancement by multiresolution representations ofthe dyadic wavelet transform. We formulate two examples in which a linear enhancement operator isshown mathematically equivalent to traditional unsharp masking with a Gaussian low-pass �lter. Aformal analysis of wavelet �lter selection and associated artifacts is carried out. Then we show thattransform coe�cients, modi�ed within each level of scale by nonlinear operators, can make moreobvious unseen or barely seen features of mammography without requiring additional radiation. Inaddition, we introduce an edge-preserved denoising stage based on wavelet shrinkage with adaptivethresholding, and demonstrate that noise suppression and contrast enhancement can be achievedsimultaneously within the same framework.In the second part, we analyze arbitrary regions of interest (ROI) of a digital mammogramby (overcomplete) Deslauriers-Dubuc interval wavelets, this could provide radiologists with an in-teractive capability for local processing of suspicious lesions within large image matrix sizes. Wedemonstrate that features extracted from this multiscale representation can support an adaptivemechanism for accomplishing local contrast enhancement. Our results are compared with tradi-tional image enhancement techniques by measuring the local contrast of known mammographicfeatures.Thus we present two distinct methods of accomplishing the enhancement of mammographicfeatures in digital mammography. By improving the visualization of breast pathology we canimprove chances of early detection while requiring less time to evaluate mammograms for mostpatients. 3

Page 5: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

PART 1: DYADIC WAVELET ANALYSISImage contrast is an important factor in the subjective quality of radiographic images. Acomprehensive survey of algorithms for contrast enhancement is presented in [15]. Histogram modi-�cation techniques [16, 17] have been attractive due to their simplicity and speed. A transformationfunction is �rst derived from a desired histogram and the histogram of an input image. The trans-formation function is usually nonlinear and for continuous functions, a lossless transformation maybe achieved. However, for digital radiographs having a �nite number of gray levels, some informa-tion loss due to quatization errors is typical. For example, a subtle edge may be merged with itsneighboring pixels and disappear. Methods that incorporate local context into the transformationprocess may also have problems. For example, simple adaptive histogram equalization [18] with a�xed contextual region (window) cannot adapt to features of distinct sizes.Most edge enhancement algorithms share a common strategy: edge detection and subsequent\crispening". Unsharp masking sharpens edges by substracting a portion of a Laplacian �lteredcomponent from an original image. This technique was justi�ed as an approximation of a deblurringprocess in [19]. Loo et al. [20] studied an extension of this technique in the context of radiographs.In addition, an extension based on Laplacian �tering was proposed in [21]. However, these (unsharpmasking) techniques were limited by their linear and single scale nature, and are less e�ective forimages containing diverse features typically found in mammography. In an attempt to overcomethese limitations, a local contrast measure and nonlinear transform functions were introduced in[5], and subsequently re�ned in [22].More recently, the advancement of wavelet theory has sparked researchers in the application ofimage contrast enhancement [23, 24, 25, 26, 27, 28, 29]. These early studies revealed promisingresults, but were more experimental in design. In this part, we provide a concise mathematicalanalysis of a dyadic wavelet transform, and reveal its connection to the traditional technique ofunsharp masking. In addition, we propose a simple nonlinear enhancement function and analyzethe problem of artifacts. We next describe an explict denoising stage that preserves edges using4

Page 6: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

wavelet shrinkage [33] with adaptive thresholding. In addition, we present a two dimensional exten-tion for digital mammography and special procedures developed for accomplishing denoising andenhancement without orientation distortion. Finally, sample results are shown and comparisonsmade using both digitalized mammograms and synthetic signals.One dimensional discrete dyadic wavelet transformA fast algorithm [31] for computing 1-D discrete dyadic wavelet transform (DDWT) is shownin Figure 1. The left side shows the structure of decompsition, and the right, reconstruction. Foran N-channel structure, there are N � 1 high-pass or band-pass channels and a low-pass channel.Thus, the decomposition of a signal produces N � 1 sets of wavelet coe�cients and a coarse signal.In Figure 1, decomposition �lters di�er from reconstruction �lters. However, this structure isequivalent to the multichannel structure shown in Figure 2. This computational structure makesobvious the potential for parallel processing to support an interactive user interface for computedassisted diagnosis.Channel frequency responses Cm(!) can be written asCm(!) = Fm(!)Im(!) = 8>>><>>>: 1 � kH(!)k2 ; m = 0;Qm�1l=0 H(2l!) 2 h1� kH(2m!)k2i ; 1 � m � (N � 1);QN�1l=0 H(2l!) 2 ; m = N:As an example, we consider an extension of the class of �lters proposed in [31]H(!) = ejp!2 �cos�!2��2n+p ; (1)where p = 0, or 1. Let �m;q(!) = "m�1Yl=0 cos(2l�1!)#q ;then we can show that �m;q(!) = "sin(2m�1!)2m sin(!2 ) #q ; (2)5

Page 7: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

and therefore Cm(!) = 8><>: �m;4n+2p(!) ��m+1;4n+2p(!) ; 0 � m � (N � 1);�N;4n+2p(!) ; m = N: (3)Note that �0;n(!) = 1, and for 0 < m < N ,Cm(!) = �m;4n+2p(!) ��m+1;4n+2p(!) = sin2 �!2� 4m�m;4n+2p+2(!) 2n+p�1Xl=0 hcos �2m�1!�i2l ;and sin2 �!2� is the frequency response of the discrete Laplacian operator having an impulse responseof f1;�2; 1g.�m;q(!) with even exponential q is approximately a Gaussian function, while the frequencyresponses of channels (0 < m < N) are approximately a Laplacian of Gaussian.Linear enhancement and unsharp maskingreview of unsharp maskingA prototype of unsharp masking can be de�ned [19] as~s(x; y) = s(x; y)� k�s(x; y); (4)where � = @2@x2 + @2@y2 is the Laplacian operator. However, this original formula processed only thelevel of �nest resolution. More versatile formulas were later fashioned in two forms, described below.One way to extend the original formula was based on exploiting the averaging concept behindthe Laplacian operator. The discrete form of the Laplacian operator may be written as�s(i; j) = [s(i+ 1; j)� 2s(i; j) + s(i� 1; j)] + [s(i; j + 1) � 2s(i; j) + s(i; j � 1)]= �5�s(i; j)� 15 [s(i+ 1; j) + s(i� 1; j) + s(i; j) + s(i; j + 1) + s(i; j � 1)]�This formula shows that the discrete Laplacian operator can be implemented by substracting fromthe value of a central point its average neighborhood. Thus, an extended formula [20] can be writtenas ~s(i; j) = s(i; j) + k [s(i; j)� s(i; j) � h(i; j)] ; (5)6

Page 8: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

where h(i; j) is a discrete averaging �lter, and � denotes convolution. For example, in [20] anequal-weighted averaging mask was used:h(x; y) = ( 1=N2; jxj < N=2; jyj < N=20; otherwise:Another way to extend the prototype formula [21] came from the idea of a Laplacian-of-Gaussian�lter, which expands Equation (4) into~s(x; y) = s(x; y)� k�[s(x; y) � g(x; y)] = s(x; y)� k [s(x; y) ��g(x; y)] ; (6)where g(x; y) is an Gaussian function, and �g(x; y) is a Laplacian-of-Gaussian �lter.Finally, we mention that both extensions (Equations (5) and (6)) are limited to a single scale.unsharp masking is included within a DDWT frameworkNext, we prove that unsharp masking with a Gaussian lowpass �lter can be included in adyadic wavelet framework for enhancement by considering two special cases of linear enhancement.In the �rst case, transform coe�cients of channels 0 � m � N � 1 are enhanced (multiplied) bythe same gain G0 > 1, or Gm = G0 > 1; 0 � m � N � 1. The system frequency response is thusV (!) = N�1Xm=0GmCm(!) + CN (!) = G0 NXm=0Cm(!)� (G0 � 1)CN (!)= G0 � (G0 � 1)CN(!) = 1 + (G0 � 1) [1� CN (!)] :The input-output relationship of the system is then simply~s[i] = s[i] + (G0 � 1) fs[i]� s[i] � cN [i]g : (7)Since CN (!) is approximately a Gaussian lowpass �lter, Equation (7) may be seen as the 1-Dcounterpart of Equation (5).In the second case, transform coe�cients of a single channel p, 0 � p < N are enhanced (multi-plied) by a gain Gp > 1, thusV (!) = Xm6=pCm(!) +GpCp(!) = NXm=0Cm(!) + (Gp � 1)Cp(!) = 1 + (Gp � 1)Cp(!): (8)7

Page 9: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Using the �lter class of Equation (1), the input-output relationship of the system de�ned inEquation (8) can be written as~s[i] = s[i]� (Gp � 1) �� fs[i] � �[i]g ; (9)where �[i] is the impulse response of an approximate Gaussian �lter. Similarily, Equation (9) maybe seen as the 1-D counterpart of Equation (6). The inclusion of these two forms of unsharp maskingclearly demonstrate the exibility and versatility of this dyadic wavelet framework.Figure 3 shows an example of linear enhancement using uniform gains across scales. This ex-ample clearly demonstrates an increase of local contrast marked by a steeper slope and localizedemphasis (undershooting and overshooting). Note that the observed undershooting and overshoot-ing associated with the strong edge is much larger than that of the weaker edge. Therefore, linearenhancement techniques are especially well suited for the enhancement of microcalci�cations.Nonlinear enhancement by functional mappingHowever, linear enhancement tends only to emphasize strong edges, which can lead to in-e�cient usage of the dynamic range available on a display screen. For example, mammogramsenhanced by a linear operator containing a single obvious (high intensity) macrocalci�cation willresult in gross rescaling with the available dynamic range. This makes the detection of subtle fea-tures of importance to mammography more di�cult. Below, we show how this problem may besolved by a simple nonlinear method. Linear enhancement can be seen as a mapping of waveletcoe�cients by a linear function Em(x) = Gmx. A direct extension of linear enhancement is anonlinear mapping function, described next.�lter selection and enhancement function designFor linear enhancement, selection of the �lters G(!) (and thus K(!)) make little di�erence.However, the selection of �lters is critical for the nonlinear case. We chose a discrete Laplacianoperator as the �lter G(!). A discrete Laplacian operator can be implemented by the �lterG(!) = �4 �sin�!2��2 ; or g[n] = f1;�2; 1g;8

Page 10: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

such that g[n] � s[n] = s[n+ 1]� 2s[n] + s[n� 1].In addition, both �lters H(!) and K(!) can be symmetric,H(!) = �cos�!2 ��2n ; and K(!) = 1� kH(!)k2G(!) = �14 2n�1Xl=0 �cos�!2��2l :Our guidelines for designing a nonlinear enhancement function were:(1) An area of low contrast should be enhanced more than an area of high contrast. This isequivalent to saying that small values of wm[i] should be assigned larger gains.(2) A sharp edge should not be blurred.In addition, an enhancement function may be further subjected to the constraints:(1) Monotonicity, in order not to change the position of local extrema, nor create new extrema.(2) Antisymmetry, E(�x) = �E(x), in order to preserve phase polarity for \edge crispening".A simple piecewise linear function that satis�es these conditions is shown in Figure 4,E(x) = 8><>: x� (K � 1)T ; if x < �TKx ; if jxj � Tx+ (K � 1)T ; if x > T (10)where K > 1. Note that for T � maxfjw[n]jg, every wavelet coe�cient will be multiplied by again of K0, reducing the function to a linear function. This implies that our nonlinear algorithmincludes unsharp masking as a subset.threshold selectionFor each level m, an enhancement operator Em has two parameters: threshold Tm and gainKm. In our experimental studies, gain was the same value across levels such that Km = K0; 0 �m � N � 1, and Tm was set in two distinct ways according to the two considerations mentionedearlier in this section.(1) For the purpose of enhancing weak features, we set threshold Tm = t�maxfjwm[n]jg, where0 < t < 1 was user speci�ed. By setting a small t across levels, we assured that weak features9

Page 11: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

at distinct scales were always favored and e�ectively enhanced. Figure 5 shows a numericalexample of nonlinear enhancement. Note that enhancement of both edges is accomplished(especially the weak edge).(2) To make e�cient use of the dynamic range of the computer screen, thresholds were boundin the following way: At each level, the magnitudes of wavelet coe�cients were quantized into1024 bins, and a distribution (histogram) h was computed. For a user speci�ed t, 0<t<1,an actual threshold Tm was computed such that �PN�1n=k h[n]� = �PN�1n=0 h[n]� � t. Thus, thethreshold Tm divided the range of wavelet coe�cients into two regions. The region with valueslarger than the threshold Tm was then compressed, and the lower region stretched. Figure 6shows sample result for the digital mammogram shown in Figure 10 (a).We claim that our multiscale algorithm provides a marked improvement over traditional tech-niques in two respects:1. The e�cient multiscale (or multimask) decomposition localizes searches for features exist-ing within distinct scales, making the traditional (try-and-fail) strategy of window selectionunnecessary.2. The nonlinear algorithm enhances small features within each scale without blurring the edgesof larger features. Thus making possible the simultaneous enhancement of features of varioussize.Furthermore, artifacts possibly created by a nonlinear enhancement operator can be limited byjudicious selection of �lter and design constraints. For example, the arguments presented belowassure that no new extrema (artifacts) will be created within each channel.1. Filters are zero-phase. No spatial shifting of features exists in the transform space.2. E(x) is a monotonically increasing function, and thus will not produce new extrema points.3. The reconstruction �lters are simply zero-phase smoothing �lters.10

Page 12: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

The nonlinear enhancement methods described above do not take into account the presence ofnoise. In general, noise exists in a digitized image due to the imaging device and quantization. Asa result of nonlinear processing, noise may be ampli�ed and may diminish the bene�ts of contrastenhancement. In the next section, we present a method to accomplish denoising.Incorporating denoising into enhancementUnfortunately, denoising is a very di�cult problem. Fundamentally, there is no absoluteboundary to distinguish a feature from noise. Even if there are known characteristics for a particulartype of noise, it may be theoretically impossible to completely seperate the noise from features ofinterest. Therefore, denoising methods may be seen as ways to suppress very high frequency andincoherent components of an input signal.A very simple method of denoising that is equivalent to low-pass �ltering is naturally included ina dyadic wavelet framework. That is, simply discard several channels of high spatial frequency, andenhance channels of lower frequency. The problem associated with this linear denoising approachis that edges are blurred signi�cantly, rendering it unsuitable for contrast enhancement. In orderto achieve edge-preserved denoising, more sophisticated methods based on wavelet analysis havebeen proposed. Mallat and Hwang [32] connected noise behavior to singularities. Their algorithmwas based on a multiscale edge representation. The algorithm traced modulus wavelet maximato evaluate local Lipschitz exponents and deleted maxima points with a negative Lipschitz value.In addition, Donoho [33] proposed nonlinear wavelet shrinkage. This algorithm reduced waveletcoe�cient values towards zero based on a level-depedent threshold.A denoising stage based on wavelet shrinkage can be incorporated into our enhancement al-gorithm. However, there are two arguments which favor shrinking gradient coe�cients instead ofLaplacian coe�cients [34].In the previous section, we argued that nonlinear enhancement should be performed on Laplaciancoe�cients. Therefore, in order to incorporate denoising into our enhancement algorithm, we split11

Page 13: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

the Laplacian operator into two cascaded gradient operators. Note thatGm(!) = �4 hsin �2m�1!�i2 = 8<: he�j!=2Gd(!2 )i hej!=2Gd(!2 )i ; if m = 0;[Gd(2m�1!)]2 ; otherwise. (11)where Gd(!) = 2j sin(!).Denoising by wavelet shrinkage [33] can then be incorporated into this structure as illustratedin Figure 7, where the shrinking operator can be written asC(x) = sign(x) � ( jxj � Tn ; if jxj > Tn;0 ; otherwise:For our application to digital mammography, we have chosen a shrinking operator that is a piece-wise linear and monotonically non-decreasing function, that will not introduce artifacts.Two dimensional extensionFor processing digital mammograms, the one dimensional structures presented above weresimply extended for two dimensions. We �rst adopted the method proposed by Mallat [31], shownin Figure 8, where �lter L(!) = 1+jH(!)j22 , and H(!), K(!) and G(!) were the same �lters used inthe 1-D case.However, experimentally we observed that if we simply modi�ed the two oriented wavelet coe�-cients independently, orientation distortions were introduced. These potentially disastrous artifactswere avoided by applying a denoising operation to the magnitude of gradient coe�cients, and thenapplying a nonlinear enhancement operation on the sum of the Laplacian coe�cients, as shown inFigure 9. For the two oriented gradient coe�cients wx1 and wy1, the magnitude M and phase Pwere computed as M = qwx21 + wy21 and P = arctan(wy1=wx1), respectively. The denoising oper-ation was then applied to M , obtaining M 0. The denoised coe�cients were then simply restoredas wx01 =M 0 � cos(P ) and wy01 =M 0 � sin(P ), respectively. For the enhancement operation, noticethat the sum of two Laplacian components is isotropic. Therefore, we computed the sum of the twoLaplacian components as S = wx2 + wy2 and C = wx2=S. A nonlinear enhancement operator wasthen applied to S only, producing S 0. Thus, the two restored components were wx02 = S0 � C andwy02 = S 0 � (1� C). 12

Page 14: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Experimental resultsIn this section, we present some samples of our experimental results. In our study, �lmradiographs of the breast were digitized using a sampling size of 210 microns, on a Kodak laser �lmdigitizer, with 10-bit quantization (contrast resolution).Figure 10(a) shows a digital mammogram of size 400x512 containing a stellate lesion. Figure10(b) shows a nonlinear enhancement of the radiograph. The structure of the lesion is more clearlyshown, as well as the boundary tissue of the breast. The local e�ect of contrast enhancement canbe appreciated more precisely by the detail of the scan line comparison shown in Figure 11.Figure 12 (a) shows a digital mammogram of size 512x512 containing stellate lesions. Figure12(b) shows the image after processing by nonlinear enhancement. The structure and borders of thelesions are well de�ned, as are the vascular, nipple and glandular tissues. The bene�t of contrastenhancement can be seen by the subtle variations of the scan line pro�le compared in Figure 13.PART 2: INTERVAL WAVELETSWe next describe a method for accomplishing an interactive paradigm for adaptive contrastenhancement [23, 24, 25, 26, 28]. In this study, we have investigated Deslauriers-Dubuc interpolationwavelets [35, 36] constructed on the interval to compute a multiscale representation. Mammogramswere reconstructed from transform coe�cients modi�ed at each level by local and global nonlinearoperators. This representation was attractive because it subdued the \edge e�ects" of traditionalmultiresolution representations (based on perodization of a �nite signal to a signal on a line; orsimply adding zeros to extend a signal on a line). The shape of the basis functions for theserepresentations can be symmetric or antisymmetric, and allow for perfect reconstruction. In thispaper, we applied this analysis to decompose an arbitrary region of interest of a mammogram, sothat a selected region could be analyzed independent of its surrounding context.In many applications, a signal has �nite length, such that the signal lives on the interval [0; 1],or in the two dimmensional case, an image. Cohen and Daubechies [37] and Jawerth [40] adapted13

Page 15: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

multiresoluton analysis on the line to \life on the interval", where a sequence of successive approx-imation spaces on the interval were constructed as: Sj2Z Vj = L2[0; 1]; Tj2Z Vj = f0g: By de�ningWj as an orthogonal complement of Vj in Vj�1, Vj�1 = VjLWj; the space L2[0; 1] can be representdas a direct sum L2[0; 1] = Lj2ZWj:Deslauriers-Dubuc interpolationIn this study we investigated multiresolution representations of the Deslauriers-Dubuc funda-mental functions [35, 36]. Figure 14 shows a fundamental solution of Deslauriers-Dubuc interpola-tion and its associated wavelet (D = 3).Donoho [38] showed how to adapt the Deslauriers-Dubuc interpolating transform to \life on theinterval". Suppose that �j;k is a scaling function on the line. The scaling functions on the interval intervj;k can be derived as follows: (1) Within the interior of the interval, they are simply the sameas on the real line �intervj;k = �j;k; D < k < 2j �D � 1:(2) On the edges of the interval, they are dialations of the boudary adjusted functions�intervj;k = 2j=2�leftk (2jx� k); 0 � k � D;�intervj;2j�k�1 = 2j=2�rightk (2jx� 2j � k � 1); 0 � k � D:Thus for the spaces Vj[0; 1] we can de�ne the functions:�intervj;k = 8><>: �leftj;k 0 � k � D�j;k D < k < 2j �D � 1�rightj;k 2j �D � 1 � k � 2j:Similarly, we can construct wavelets on the interval for the detail spaces Wj [0; 1]: intervj;k = 8><>: leftj;k 0 � k < bD=2c j;k bD=2c � k < 2j � bD=2c rightj;k 2j � bD=2c � k < 2j :In addition, Donoho [38] showed that if j0 is a non-negative integer satisfying 2j0 > 2D+2 (de�ningnon-interacting boundaries), then there exists a collection of functions �intervj;k and intervj;k such that14

Page 16: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

every f 2 C[0; 1] has a representationf = 2j0�1Xk=0 sj;k�intervj0;k + Xj�j0 2j�1Xk=0 dj;k intervj;k ;with a uniform convergence of partial sums j � j1 as j1 ! 1. For a detailed construction of�intervj;k and intervj;k , please refer to reference [38]. Tables 1 and 2 show the discrete �lters used in ourstudy for the case of D = 3. Figure 15 shows the boudaries of the associated interval wavelets. Anexample of the processing structures for the one dimensional case is shown is Figure 16.Enhancement techniquesTo accomplish multiscale contrast enhancement, both local and global techniques for image en-hancement were applied to each multiresolution representation. For the interval wavelet basis, therewere four components in the transform space: horizontal, vertical, diagonal, and a DC component,represented by di1; di3; di3; si respectively, where i is the transform level. Let s be the original mam-mogram, g be the function designed to emphasize features of importance within a selected level i,and L be the number of levels in a transform. Then an enhanced image may be given bys = LXi=1W�1(g(di1); g(di2); g(di3); si): (12)In general, by de�ning a function g, we can denote speci�c enhancement schemes for modifying thecoe�cients within distinct levels of scale-space.local enancement techniquesA problem for image enhancement in digital mammography is the ability to emphasize mam-mographic features while reducing the enhancement of noise. In [23, 24, 25, 26] we presented a localenhancement technique for digital mammography based on multiscale edges. In this study, localenhancement was supported bydi1(m;n) = 8<: di1(m;n); if ei(m;n) � T i,gi di1(m;n); if ei(m;n) > T i,15

Page 17: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

where m and n denote coordinates in the spatial domain, ei was the edge set corresponding totranform space component di1, gi was a local gain, and T i was a threshold at level i, gi and T i wereselected adaptively. The edge set ei of di1 was the local maxima of di1 along the horizontal direction.For di2 and di3, the direction was along the vertical and diagonal orientations (45o) respectively.Speci�cally ei(m;n) = 8>><>>: jdi1(m;n)j; if jdi1(m;n)j > jdi1(m + 1; n)j andjdi1(m;n)j > jdi1(m� 1; n)j,0; otherwise.The processing of di2 and di3 is similar. By replacing di1; di2 and di3 in Equation (1) with correspondingmodi�ed components di1, di2 and di3, we obtain an enhanced image s.multiscale adaptive gainIn this approach, we suppressed pixel values of very small amplitude, and enhanced only thosepixels that were larger than a certain threshold T within each level of transform space. We designedthe following function to accomplish this non-linear operation [28]:f(y) = a [sigm(c(y � b))� sigm(�c(y + b))] ; (13)where a = 1sigm(c(1� b))� sigm(�c(1 + b)) ;0 < b < 1;sigm(y) is de�ned by sigm(y) = 11 + e�y ;and, b and c control the threshold and rate of enhancement, respectively. It can be easily shown thatf(y) is continuous and monotonically increasing within the interval [�1; 1] (similar to histogramequalization). Furthermore, a derivative of f(y) of any order exists and is continuous. Therefore,enhancement accomplished by f(y) will not introduce any new discontinuities (artifacts).Experimental results and discussion16

Page 18: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Preliminary results have shown that the multiscale processing techniques described above canmake unseen or barely seen features of a mammogram more obvious without requiring additionalradiation. Our study suggests that these techniques can improve the visualization of features ofimportance to mammography and assist the radiologist in the early detection of breast cancer.Mathematical models of phantoms were constructed to validate our enhancement techniquesagainst false positives arising from possible artifacts introduced by our enhancement methods and toevaluate contrast improvement quantitatively. Our models included features of regular and irregularshapes and sizes of interest in mammographic imaging, such as microcalci�cations, cylindrical andspicular objects, and conventional masses. Techniques for \blending" a normal mammogram withthe images of mathematical models were developed. The purpose of these experiments was totest the performance of our processing techniques on inputs known \a priori" using mammogramswhere the objects of interest were deliberately obscured by normal breast tissues. The \imaging"justi�cation for \blending" is readily apparent; a cancer is visible in a mammogram because ofits (slightly) higher X-ray attenuation which causes a lower radiation exposure on the �lm in theappropriate region of a projected image.Figure 18(a) shows an example of a mammogram whereby the mathematical phantom shownin Figure 18(b) has been blended into a clinically-proven, cancer-free mammogram Figure 18(a).The image shown in Figure 18(c) was constructed by adding the amplitude of the mathematicalphantom image to the cancer free mammogram followed by local smoothing.Before applying our processing techniques, a computer simulated phantom was developed toboth characterize and optimize each wavelet based enhancement algorithm [13], such as the levelsof analysis, threshold (T) and gain (c) parameter values. This early study enabled us to computean enhancement factor (EF) which was used to quantitatively measure algorithm performance. EFwas de�ned as the ratio of output to input contrast noise ratios (CNR). The study found thatcomputed EF values correlated well with the feature detection performance of radiologists.In addition, radiologists at Shands Hospital at the University of Florida validated that processingthe blended mammogram with our local enhancement techniques introduced no signi�cant artifacts17

Page 19: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

and preserved the shapes of the known mammographic features (calci�cations, dominant masses,and spicular lesions) contained in the original mathematical phantom.Enhancement by multiscale edges provided a signi�cant improvement in local contrast for eachfeature included in the blended mammogram. A quantitative measure of contrast improvement canbe de�ned by a Contrast Improvement Index (CII), CII = CProcessedCOriginal ; where CProcessed and COriginalare the contrast values for a region of interest in the processed and original images, respectively.In this paper we adopted a version of the optical de�nition of contrast introduced by Morrow etal. [39]. The contrast C of an object was de�ned by C = f�bf+b ; where f was the mean gray-level valueof a particular object in the image (foreground), and b was the mean gray-level value of a surroundingregion (background). This de�nition of contrast has the advantage of being independent of the actualrange of gray levels in the image. For each feature included in the mathematical phantom, localmasks were de�ned to separate the foreground and background regions of each feature in the blendedmammogram.Figure 19(a) shows the result after processing the blended mammogramwith adaptive histogramequalization (AHE). Figure 19(b) was obtained after reconstructing the blended mammogram frominterval wavelet transform coe�cients modi�ed by multiscale adaptive gain processing (GAIN).Figure 19(c) shows the result after processing the blended mammogram with unsharp masking(UNS). Figures 19(d) shows the result obtained after reconstructing the blended mammogramfrom interval wavelet transform coe�cients modi�ed by multiscale edges (EDGE). Figure 20 showsenlarged areas (16X) containing each feature in the processed mammogram for each method ofcontrast enhancement. The images in each row of Figure 20 were rescaled by the same lineartransformation.Table 3 shows the contrast values for the original and enhanced mammographic features shown inFigure 19, while Table 4 shows the values for CII. From the two tables we observed that both GAINand EDGE enhancement methods performed signi�cantly better than unsharp masking (UNS) andadaptive histogram equalization (AHE).Figure 21 demonstrats the improvement of local contrast accomplished by GAIN for a sample18

Page 20: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

scan line pro�le taken from cross sections of each features. Figure 22 shows the improvement oflocal contrast for the same scan line accomplished by the EDGE method. Note that in all casescontrast was improved while preserving the overall shape of each feature pro�le.By applying wavelets constructed on the interval, we can more e�ciently accomplish enhance-ment of an arbitrary region of interest (ROI) of a digital mammogram. Figure 23(a) shows theenhancement of an arbitrary region of interest using adaptive gain processing of an DD intervalwavelet interpolation basis. Figure 23(b) shows the enhancement of an arbitrary region of interestusing multiscale edges of the same interval wavelet basis. The decomposition of the selected ROIwas computed by processing horizontal and vertical \scan lines". Enhancement was then achievedby modifying only the coe�cients within the ROI, and then simply reconstructing.By constraining the enhancement to a speci�c region, computation costs were greatly reduced.For example, Table 5 shows the comparison of actual computation time for processing an entiremamogram (complete image matrix) versus a selected ROI.In summary, methods for accomplishing adaptive contrast enhancement by a multiscale rep-resentation were investigated. Contrast enhancement was applied to features of speci�c interestto mammography including masses, spicules and microcalci�cations. Multiresolution representa-tions provided an adaptive mechanism for the local emphasis of such features blended into digitizedmammograms. In general, improvements in image contrast based on multiscale processing were su-perior to those obtained using competitive algorithms of unsharp masking and adaptive histogramequalization.Using Deslauriers-Dubuc interpolation interval wavelets, we demonstrated the enhancementof arbitrary regions of interest. This can provide radiologists with an interactive capability forenhancing only suspicious regions of a mammogram, at a reduced computational cost.19

Page 21: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

CONCLUSIONIn both studies above, multiresolution representations provided an adaptive mechanism for thelocal emphasis of features of importance to mammography. In general, improvements in imagecontrast for multiscale image processing algorithms were superior to those obtained using existingcompetitive algorithms. These initial results are encouraging and suggest that wavelet based imageprocessing algorithms could play an important role in improving the imaging performance of digitalmammography.However, in Part 2, features blended into the mammograms were \idealized" representations ofthe types of objects that are of primary interest to mammographers. The resultant mammographicimages were appropriate for the purpose of demonstrating improved image contrast made possibleby wavelet based image processing algorithms. Furthermore, these images were also useful forcomparing multiscale wavelet based algorithms with existing image processing algorithms. The testresults obtained in this study, however, cannot be directly extrapolated to clinical mammography.In addition, it is also important to study possible image artifacts introduced by new wavelet �lterswhich may adversely a�ect imaging performance by increasing the false positive rate.Thus, it is essential that further studies are performed to identify the most promising approachesof multiscale based image processing algorithms. The identi�cation of the most appropriate basisfunctions for enhancing speci�c types of mammographic features needs further investigation. Thebest way of selecting wavelet coe�cients for enhancement, and their degree of enhancement, alsomerit systematic analysis. Ultimately, however, the objective of any image processing is to improvethe visibility of clinically signi�cant features in mammograms. Accordingly, the most promisingalgorithms require evaluation using clinical mammograms. In the near future, such tests will bedesigned to measure the ability of multiscale image processing to signi�cantly improve the sensitivity,speci�city and overall accuracy of mammographic interpretation.20

Page 22: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

AcknowledgementsThis work was sponsored in part by the Whikaker Foundation and the U.S. Army Medical Re-search and Development Command, Grant No. DAMD17-93-J-3003. Special thanks to Dr. WalterHuda and Sergio Schuler for their assistance in metrics for the evaluation of contrast performance.

21

Page 23: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

References[1] R.A. Smith, \epidemiology of breast cancer" in A categorical course in physics. Technical as-pects of breast imaging, A.G. Haus and M.J. Ya�e, Eds. Radiological Society of North America,1993, pp. 21-33, Presented at the 79th scienti�c assembly and annual meeting of the RSNA.[2] P.C. Johns and M.J. Ya�e. \X-ray characterization of normal and neoplastic breast tissues"Physics in Medicine and Biology, Vol. 32, No. 6, pp. 675-695, Feb. 1987.[3] M.J. Ya�e and R.J. Jennings and R. Fahrig and T.R. Fewell. \X-ray spectral considerations formammography" in A categorical course in physics. Technical aspects of breast imaging, A.G.Haus and M.J. Ya�e, Eds. Radiological Society of North America, 1993, pp. 63-72, Presentedat the 79th scienti�c assembly and annual meeting of the RSNA.[4] I. Brodie and R.A. Gutcheck. \radiographic information theory and application to mammog-raphy" Medical Physics, Vol. 9, 1982.[5] R. Gorden, R.M. Rangayyan, \feature enhancement of �lm mammograms using �xed andadaptive neighborhoods," Applied Optics, Vol. 23, pp. 560, 1984.[6] A.P. Dhawan, G. Buelloni, R. Gordon, \enhancement of mammographic features by optimaladaptive neighborhood image processing," IEEE Transactions on Medical Imaging, Vol. MI-5,pp. 8, 1986.[7] A.P. Dhawan, R. Gordon, \reply to comments on enhancement of mammographic features byoptimal adaptive neighborhood image processing," IEEE Transactions on Medical Imaging,Vol. MI-6, pp. 82, 1987.[8] A.P. Dhawan, E. Le Royer, \mammographic feature enhancement by computerized imageprocessing," Computer Methods and Programs in Biomedicine, Vol. 27, pp. 23, 1988.22

Page 24: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

[9] P.G. Tahoces, J. Correa, M. Souto, C. Gonzalez, L. Gomez, J. Vidal, \Enhancement of chestand breast radiographs by automatic spatial �ltering," IEEE Transaction on Medical Imaging,Vol. MI-10(3), pp. 330{335, 1991.[10] D. Brzakovic and X.M. Luo and P. Brzakovic, \an approach to automated detection of tumorsin mammograms", IEEE Transaction on Medical Imaging, Vol. 9, No. 3, pp. 232-241, Sept.1990.[11] H.P. Chan and K. Doi and S. Galhotra and C.J. Vyborny and H. MacMahon and P.M. Jokich,\image feature analysis and computer-aided diagnosis in digital radiography. automated de-tection of microcalci�cations in mammography",Medical Physics, Vol. 14, No. 4, pp. 538-548,July, 1987.[12] H.P. Chan and K. Doi and C.J. Vyborny and K.L. Lam and R.A. Schmidt, \Computer-aideddetection of microcalci�cations in mammograms: Methodology and preliminary clinical study",Investigative Radiology, Vol. 23, No. 9, pp. 664-671, Sept. 1988.[13] Y. Xing, W. Huda, A. Laine, \Simulated phantom images for optimizing wavelet based imageprocessing algorithms in mammography", Proceedings of SPIE-The International Society forOptical Engineering,Vol. 2299, pp. 207-217, July, 1994.[14] T.N. Wiesel. \postnatal development of the visual cortex and the in uence of environment"Nature, Vol. 299, No. 5883, pp. 583-591, Oct. 1982.[15] D. C. Wang, A. H. Vagnucci and C. C. Li. \digital image enhancement: a survey" ComputerVision, Graphics, and Image Processing, Vol. 24, 363-381, 1983.[16] R. Hummel. \histogram modi�cation techniques" Computer Graphics and Image Processing,Vol. 4, pp. 209-224, 1975.[17] W. Frei. \image enhancement by histogram hyperbolization" Computer Graphics and ImageProcessing, Vol. 6, pp. 286-294, 1977. 23

Page 25: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

[18] S. M. Pizer, E. P. Amburn, et al. \adaptive histogram equalization and its variations" ComputerVision, Graphics, and Image Processing, Vol. 39, 355-368, 1987.[19] A. Rosenfeld and A.C. Kak. \digital picture processing" Academic Press, Second edition, NewYork, 1982.[20] L.D. Loo, K. Doi and C.E. Metz. \investigation of basic imaging properties in digital radio-grapgy. 4. e�ect of unsharp masking on the detectability of simple patterns" Med. Phys., 12(2),pp. 209-214, 1985.[21] F. Neycenssac. \contrast enhancement using the Laplacian-of-a-Gaussian �lter" CVGIP:Graphical Models and Image Processing, Vol. 55, No. 6, pp. 447-463, 1993.[22] A. Beghdadi and A. L. Negrate. \contrast enhancement technique based on local detection ofedges" Comput. Vision Graphics Image Process. 46, pp. 162-174, 1989.[23] A. Laine. Multiscale wavelet representations for mammographic feature analysis. In Image En-hancement Techniques: Computer Science, National Cancer Institute Breast Imaging Work-shop: State-of-the-Art and New Technologies, Bethesda, MD, September 1991.[24] A. Laine, S. Song. Multiscale wavelet representations for mammographic feature analysis. InProceedings of SPIE: Conference on Mathematical Methods in Medical Imaging, San Diego,CA, July 23{25, 1992.[25] A. Laine, S. Song. Wavelet processing techniques for digital mammography. In Proceedings ofSPIE: Conference on Visualization in Biomedical Computing, Chapel Hill, NC, October 13{16,1992.[26] A. Laine, S. Song, J. Fan. Adaptive Multiscale Processing for Contrast Enhancement. In Pro-ceedings of SPIE: Conference on Biomedical Imaging and Biomedical Visualization, San Jose,CA, January 31{February 4, 1993. 24

Page 26: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

[27] B. D. Jawerth, M. L. Hilton and T. L. Huntsberger. Local enhancement of compressed images.J. Mathematical Imaging and Vision, Vol. 3 , pp. 39{49, 1993.[28] A. Laine, S. Schuler, J. Fan, W. Huda. Mammographic feature enhancement by multiscaleanalysis. IEEE Trans. on Medical Imaging, Vol. 13, No. 14, pp. 725{740, Dec. 1994.[29] J. Lu and D.M. Healy Jr. Contrast enhancement of medical images using multiscale edgerepresentation. In Proceedings of SPIE: Wavelet applications, Orlando, FL, April 5{8, 1994.[30] S.Mallat. \a theory for multiresolution signal decomposition : the wavelet representation".IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-11, pp. 674{693, 1989.[31] S.Mallat and Sifen Zhong. \characterization of signals from multiscale edges". IEEE Trans.Pattern Anal. Machine Intell., vol. PAMI-14, pp. 710{732, 1992.[32] S.Mallat and W. L. Hwang. \sigularity detection and processing with wavelets". IEEE Trans.Inform. Theory, Vol.38, NO. 2, pp. 617{643, 1992.[33] D. L. Donoho. \nonlinear wavelet methods for recovery of signals, densities, and spectra fromindirect and noisy data" Proc. Symposia Applied Math. , Vol. 0, 1993[34] Jian Fan and A. Laine. \contrast enhancement by multiscale and nonlinear operators", Tech-nical report, University of Florida, 1994.[35] G. Deslauriers, S. Dubuc, \Symmetric iterative interpolation process," Constructive Approxi-mation, vol. 5, pp. 49{68, 1989.[36] S. Dubuc, \Interpolation through an iterative scheme," J. Math. Anal. and Appl., vol. 114, pp.185{204, 1986.[37] A. Cohen, I. Daubechies, \Wavelets on the interval and fast wavelet transforms," Applied andComputational Harmonic Analysis, Vol. 1(1), pp. 54{81, 1993.25

Page 27: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

[38] D. L. Donoho, \Smooth wavelet decomposition with blocky coe�cient kernels," Recent Ad-vances in Wavelet Analysis, pp. 1{43, Academic Press , Inc., Boston, 1994.[39] W. M. Morrow, R.B. Paranjape, R.M. Rangayyan, J.E.L. Desautels. Region-based contrastenhancement of mammograms. IEEE Transactions on Medical Imaging. Vol. 11(3): 392{406,1992.[40] L. Anderson, N Hall, B. Jawerth, and G. Peters, \Wavelets on closed subsets of the real line,"Topics In the Theory and Applications of Wavelets, Larry L. Schumaker and Glenn Webb, Eds,Academic Press, Boston.

26

Page 28: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

G (ω) (ω)K

H (ω)

G(2ω) K (2ω)

H (2ω) H (2ω)*

G(4ω)

H (4ω)

K (4ω)

H (4ω)*

H (ω)*

E

E

E

Figure 1: One dimensional discrete dyadic wavelet transform (three-levels shown).F (ω)0

F (ω)1

F (ω)2

F (ω)3

I (ω)0

I (ω)1

I (ω)3

(ω)2I

E

E

EFigure 2: An equivalent multi-channel structure for three-level DDWT.

Page 29: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

80 100 120 140 160 180 200 220 240 260 280

−0.2

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

Figure 3: Three level linear enhancement (solid line) for Gm = 10, overlayed with the original signal(dotted line).-5 -4 -3 -2 -1 0 1 2 3 4 5

-15

-10

-5

0

5

10

15

Figure 4: Enhancement function E(x), for T = 0:5 and K = 20.

Page 30: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

80 100 120 140 160 180 200 220 240 260 280−0.2

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

Figure 5: 1-D contrast enhancement by three-level dyadic wavelet analysis with a nonlinear operator,t = 0:06 and Gm = 20. (solid line: enhanced signal; dotted line: original signal).0 20 40 60 80 100 120

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

0 50 100 150 200 250 3000

2000

4000

6000

8000

10000

12000

14000

16000

(a) (b)Figure 6: (a) Distribution of wavelet coe�cient magnitudes for level 1. (b) Distribution of waveletcoe�cient magnitudes after enhancement processing (t = 0:02 and G = 20).(x)EG (ω)d G (ω)dFigure 7: Incorporating wavelet shrinkage into an enhancement framework (level one shown).

Page 31: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

*

LK y( )ω ( )ωx

G( )ωx

G y( )ω

H H y( )ω( )ωx H H* y( )ω( )ωx

H H ( ωy)2** x( ω )2

K L( ωy)2 x( ω )2

K L( ωy)2x( ω )2

H H( ωy)2x( ω )2

G( ωy)2

x( ω )2G

LK ( )ωx y( )ω

Figure 8: Two dimensional dyadic wavelet transform (two levels shown).Gd ( )ωx

Gd y( )ω

Gd ( )ωx

Gd y( )ω

E( )SFigure 9: Denoising and enhancement for the 2-D case (level one shown).

Page 32: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a) (b)Figure 10: (a) Original mammogram M63.(b) Nonlinear enhancement with denoising, N = 5, Gm = 20, t = 0:02 (Type 2 thresholding).0 50 100 150 200 250 300 350 400

20

40

60

80

100

120

140

160

180

200

220

Figure 11: Sample horizontal scan line from M63 (107 pixels from the top) comparing enhancementwith original pro�le (dotted line: original, solid line: enhanced).

Page 33: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a) (b)Figure 12: (a) Original mammogram image M87. (b) Nonlinear enhancement with denoising,N = 5, Gm = 20, t = 0:1 (Type 1 thresholding).50 100 150 200 250 300 350 400 450 500

50

100

150

200

250

Figure 13: Sample horizontal scan line from M87 (located 210 lines from the top) comparingenhancement with original pro�le (dotted line: original, solid line: enhanced).

Page 34: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

-3 -2 -1 0 1 2 3-0.2

0

0.2

0.4

0.6

0.8

1

-3 -2 -1 0 1 2 3

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

1

1.2

(a) (b)Figure 14: (a) Re�nement relation for Deslauries-Dubuc interpolation.(b) Interval wavelet plot, D = 3.L I R

0 1 2 13 14 15

R

I

L

Sample signal length 2 = 16, D = 3.j

Support of left wavelet, [0-1].

Support of interior wavelet, [2-13].

Support of right wavelet, [14-15].Figure 15: Example of interval wavelet boundaries.

Page 35: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

DS

S

2j+1

j

j2

2

multiplication by K* K

* K

* K

discard one sample out of two

Refine (a)S

D 2

Sj

j

j+1

2

2

2

K/ K

/ K

discard one sample out of two

insert one zero between each sample

division by

Refine (b)interrior2

left

right

Refine

U

means process

means convolve with filter

Symbol

Symbol

I

β β

αα

R

L

(c)Figure 16: Processing overview for analysis and sythesis by interval wavelets.In the above diagrams, K = p2. For simplicity, only one-dimensional case is shown. (a) Decomposition structure.(b) Reconstruction structure. (c) Re�nement processing structure.

Page 36: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

row

column(a) (b)Figure 17: (a) Interactive selection of ROI by radiologist. (b) ROI is processed based on tensorproduct: each row is processed, followed by the processing of each column.

Page 37: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a)(b) (c)Figure 18: (a) Original dense mammogram, M56. (b) Mathematical phantom. (c) MammogramM56 blended with phantom image.

Page 38: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a) (b)(c) (d)Figure 19: Blended mammogram: (a) Enhancement by adaptive histogram equalizaiton, (b) En-hancement by adaptive gain processing of DD interpolation coe�cients, (c) Enhancement by tra-ditional unsharp masking, (d) Enhancement by multiscale edges of DD interpolation coe�cients.

Page 39: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a) (b) (c) (d) (e)Figure 20: Contrast enhancement of features in blended mammogram. Phantom mammographicfeatures from top to bottom: minute microcalci�cation cluster, microcalci�cation cluster, spicularlesion, circular (arterial) calci�cation, and a well-circumscribed mass. (a) Original image. (b) En-hancement by unsharp masking. (c) Enhancement by adaptive histogram equalization. (d) En-hancement by adaptive gain processing of DD wavelet coe�cients. (e) Local enhancement bymultiscale edges of DD wavelet coe�cients.

Page 40: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

100 110 120 130 140 150 160

140

160

180

200

220

240

260

280

300

300 310 320 330 340 350 360

100

120

140

160

180

200

220

240

260

280

300

(a) (b)200 205 210 215 220 225 230 235 240

150

200

250

300

160 170 180 190 200 210 220140

160

180

200

220

240

260

280

300

320

340

(c) (d)315 320 325 330 335 340 345 350

160

170

180

190

200

210

220

230

240

250

260 Legend:| Original mammogram.� � � Local enhancement bymultiscale edges.(e)Figure 21: Sample scan lines displaying enhancement by the method of adaptive gain processingof DD wavelet coe�cients: (a) minute microcalci�cation cluster, (b) microcalci�cation cluster,(c) spicular lesion, (d) circular (arterial) calci�cation and (e) well-circumscribed mass.

Page 41: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

100 110 120 130 140 150 160

150

200

250

300

350

300 310 320 330 340 350 360120

140

160

180

200

220

240

260

280

300

(a) (b)200 205 210 215 220 225 230 235 240

160

180

200

220

240

260

280

300

320

150 160 170 180 190 200 210 220160

180

200

220

240

260

280

300

(c) (d)315 320 325 330 335 340 345 350

190

200

210

220

230

240

250 Legend:| Original mammogram.� � � Local enhancement bymultiscale edges.(e)Figure 22: Sample scan lines displaying enhancement by the method of multiscale edges of DDwavelet coe�cients: (a) minute microcalci�cation cluster, (b) microcalci�cation cluster, (c) spicularlesion, (d) circular (arterial) calci�cation and (e) well-circumscribed mass.

Page 42: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

(a) (b)Figure 23: ROI enhancement of the blended mammogram shown in Figure 18(c). (a) ROI enhance-ment by adaptive gain processing of DD wavelet coe�cients. (b) ROI enhancement by multiscaleedges of DD interpolation.

Page 43: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Table 1: Filters for D = 3. LEF is the left edge �lter, REF is the right edge �lter.Edge Filtersn 0 1 2 3LEF0;n 1.0000 0 0 0LEF1;n 0.3125 0.0.9375 -0.3125 0.0625REF�2;�n 2.1875 -2.1875 1.3125 -0.3125REF�1;�n 1.0000 0 0 0Table 2: Interior Filter for D = 3.Filter for the Interiorn 0 1 2 3 4 5 6 7IF (n) -0.0625 0 0.5625 1.0000 0.5625 0 -0.0625 0Table 3: Contrast values COriginal for features in the original blended mammogram M56, CUNSfor enhancement by unsharp masking, CAHE for enhancement by adaptive histogram equaliza-tion, CEDGE for enhancement by multiscale edges obtained from Deslauriers-Dubuc interpolation(EDGE), and CGAIN for global enhancement by adaptive gain processing of Deslauriers-Dubucinterpolation (GAIN). Contrast valuesFeature COriginal CUNS CAHE CGAIN CEDGEMinute microcalci�cation cluster 0.0507 0.0674 0.0428 0.3952 0.6454Microcalci�cation cluster 0.0332 0.1227 0.1652 0.3626 0.3678Spicular lesion 0.0287 0.0579 0.1025 0.3608 0.3949Circular (arterial) calci�cation 0.0376 0.0823 0.1677 0.3014 0.4021Well-circumscribed mass 0.0035 0.0052 0.1091 0.0344 0.0397Table 4: CII for enhancement by unsharp masking (UNS), adaptive histogram equalization (AHE),and by local enhancement of multiscale edges obtained from Deslauriers-Dubuc interpolation(EDGE), adaptive gain processing of Deslauriers-Dubuc interpolation (GAIN).Contrast Improvement Index (CII) for local enhancement techniquesFeature CIIUNS CIIAHE CIIGAIN CIIEDGEMinute microcalci�cation cluster 1.3294 0.8442 7.7949 12.7298Microcalci�cation cluster 3.6958 4.9759 10.9217 11.0783Spicular lesion 2.0174 3.5714 12.5714 13.7596Circular (arterial) calci�cation 2.1888 4.4601 8.0160 10.6941Well-circumscribed mass 1.4857 31.1714 9.8286 11.3429

Page 44: A W Con...A c epte d for the Sp e cic al Issue of the EMBS Magazine entitle d "Wavelets in Me dicine," Guest Editor Metin A kay. W a v elets for Con trast Enhancemen t of Digital Mammograph

Table 5: Comparison of computation costs. Tmatrix represents the time required to process anentire mammogram, while TROI represents the time needed to process only a selected ROI. Thenumber of pixels within the ROI shown in Figure 12 was 76,267. The program was executed onSun SparcStation Model 10/30.Computation costs (in seconds)Matrix size (number of pixels) Tmatrix TROI Tmatrix=TROI512x512 748 135 5.541024x1024 5760 135 42.67