g52iip, school of computer science, university of nottingham 1 image transforms fourier transform...

57
G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

Upload: pierce-randall

Post on 25-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

1

Image Transforms

Fourier TransformBasic idea

Page 2: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

2

Image Transforms

Fourier transform theory Let f(x) be a continuous function of a real variable x.

The Fourier transform of f(x) is

Given F(u), f(x) can be obtained by using the inverse Fourier transform

dxuxjxfuF 2exp)(

duuxjuFxf 2exp)(

Page 3: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

3

Image Transforms

Fourier transform theoryThe Fourier transform F(u) is in general

complex

It is often convenient to write it in the form

uieuFujuIuRuF exp)()()( 2

122

)()()( ujIuRuF

Page 4: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

4

Image Transforms

Fourier transform theoryMagnitude and Phase

21

22 )()( uIuRuF

uR

uIu 1tan

Fourier Spectrum of f(x)

Phase angle

)()( 22 uIuRuP Power Spectrum

(spectrum density function) of f(x)

Page 5: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

5

Image Transforms

Fourier transform theory Frequency

Euler’s formula

21

22 )()( uIuRuF

uR

uIu 1tan

u is called the

frequency variable

uxjuxuxj 2sin2cos2exp

Page 6: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

6

Image Transforms

Fourier transform theory Intuitive interpretation

dxuxjxfuF 2exp)(

duuxjuFxf 2exp)(

An infinite sum of sine and cosine terms,

each u determines the frequency of its

corresponding sine cosine pair

Page 7: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

7

Image Transforms

Fourier transform

Page 8: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

8

Image Transforms

Fourier transformWhen W become smaller, what will

happen to the spectrum?

Page 9: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

9

Image Transforms

Discrete Fourier transformContinuous function f(x) is discretized

into a sequence

by taking N samples x units apart

xNxfxxfxxfxf )1(,,2,, 0000

Page 10: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

10

Image Transforms

Discrete Fourier transform pair of the sampled function

1,...,2,1,0

2exp

1 1

00

Nufor

N

uxjxxxf

NuF

N

x

1,...,2,1,0

2exp

1

0

Nxfor

N

uxjuFxf

N

u

Page 11: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

11

Image Transforms

Fourier transform of unit impulse function

0

00)(

t

tt and 1)(

dtt

0 t

Page 12: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

12

Image Transforms

Fourier transform of unit impulse function

dxexx jux)()]([ F 10

x

juxe

0 x

(x)

0 u

1

F(ju)

F

Page 13: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

13

Image Transforms

Fourier transform of unit impulse train

Here t = x and = u

Page 14: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

14

Convolution

ConvolutionThe convolution of two functions f(x) and

g(x), denote f(x)*g(x)

daaxgafxgxf )()()()(

Page 15: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

15

Convolution

ConvolutionAn example

Page 16: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

16

Convolution

Convolution and Spatial Filtering

f(x,y)

w(x,y)

f(x,y)*w(x,y)

Page 17: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

17

Convolution

Convolution theorem

uGuFxgxf

uGuFxgxf

Page 18: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

18

Sampling

Sampling

FT

FT

FT

t

-w w

t t

t

f(t) F(u)

s(t) S(u)

s(t)f(t) S(u)*F(u)

Page 19: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

19

Sampling

Sampling

FT

FT

t

t-w w

G(u)

G(u)[S(u)*F(u)]= F(u)]f(t)

-w w

Page 20: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

20

Sampling Theorem

Bandwidth, Sample Rate, and Nyquist Theorem

The sampling rate (Nyquist rate) must be at least two times the bandwidth of a bandlimited signal

wtw

t 2

12

1

t

-w w

G(u)

G(u)[S(u)*F(u)]= F(u)]

-w w

Page 21: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

21

Aliasing

Over- and under-samplingAnti-aliasing filtering

Page 22: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

22

Aliasing

Consider an image with 512 alternating vertical black and white stripes. (You may not even be able to see the alternating stripes because of poor screen resolution. But take my word for it, they are there.) Source:http://www.cs.unm.edu/~brayer/vision/perception.html

Page 23: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

23

Aliasing

The image is created by sampling an image with 512 alternating values of black (gray = 0) and white (gray = 255). Starting in row 0, 512 samples of the image are taken. For each successive row, 1 fewer sample is taken from row 0, (i.e. for row 1, take 511 samples, for row 2, take 510 samples, ... for row 511, take 1 sample). The whole row is then reconstructed from the samples by pixel replication. The result is a colossal aliasing pattern.

Source:http://www.cs.unm.edu/~brayer/vision/perception.html

Page 24: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

24

Aliasing

More examples

Page 25: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

25

Aliasing

More examples

Page 26: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

26

Aliasing

More examples

Page 27: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

27

Image Transforms

2D Fourier Transform (Fourier Transform of Images)

dxdyvyuxjyxfvuF )(2exp),(,

dudvvyuxjvuFyxf )(2exp),(,

Page 28: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

28

Image Transforms

2D Fourier Transform (Fourier Transform of Images)

21

22 ),(),(, vuIvuRvuF

vuR

vuIvu

,

,tan, 1

Fourier Spectrum of f(x)

Phase angle

),(),(, 22 vuIvuRvuP Power Spectrum

(spectrum density function) of f(x)

Page 29: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

29

Image Transforms

2D Discrete Fourier Transform (Fourier Transform of Digital Images)

1,...,2,1,01,...,2,1,0

2exp,1

,1

0

1

000

NvMufor

N

vy

M

uxjyyxxxxf

MNvuF

M

x

N

y

1,...,2,1,01,...,2,1,0

2exp,,1

0

1

0

NyMxfor

N

vy

M

uxjvvuuFyxf

M

u

N

v

Page 30: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

30

Frequency Domain Processing

What does frequency mean in an image?

Page 31: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

31

Frequency Domain Processing

What does frequency mean in an image?

Page 32: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

32

Frequency Domain Processing

What does frequency mean in an image?

Page 33: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

33

Frequency Domain Processing

What does frequency mean in an image?

High frequency components – fast changing/sharp features

Low frequency components – slow changing/smooth features

Page 34: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

34

Frequency Domain Processing

The foundation of frequency domain techniques is the convolution theorem

vuGvuFyxgyxf ,,,,

Page 35: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

35

Frequency Domain Processing

H(u, v) is called the transfer

function

Page 36: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

36

Frequency Domain Processing

Typical lowpass filters and their transfer functions

Page 37: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

37

Frequency Domain Processing

Typical lowpass filters and their transfer functions

Page 38: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

38

Frequency Domain Processing

Example

Page 39: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

39

Frequency Domain Processing

Example

Page 40: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

40

Frequency Domain Processing

Typical lowpass filters and their transfer functions

Page 41: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

41

Frequency Domain Processing

Example

Page 42: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

42

Frequency Domain Processing

Typical lowpass filters and their transfer functions

Page 43: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

43

Frequency Domain Processing

Example

Page 44: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

44

Frequency Domain Processing

Example

Page 45: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

45

Frequency Domain Processing

Example

Page 46: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

46

Frequency Domain Processing

Typical highpass filters and their transfer functions

Page 47: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

47

Frequency Domain Processing

Typical highpass filters and their transfer functions

Page 48: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

48

Frequency Domain Processing

Typical highpass filters and their transfer functions

Page 49: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

49

Frequency Domain Processing

Examples

Page 50: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

50

Frequency Domain Processing

Examples

Page 51: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

51

Frequency Domain Processing

Examples

Page 52: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

52

Frequency Domain Processing

More examples

Page 53: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

53

Frequency Domain Processing

Examples

Page 54: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

54

Frequency Domain Processing

Examples

Page 55: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

55

Frequency Domain Processing

Spatial vs frequency domain

Page 56: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

56

Frequency Domain Processing

Spatial vs frequency domain

Page 57: G52IIP, School of Computer Science, University of Nottingham 1 Image Transforms Fourier Transform Basic idea

G52IIP, School of Computer Science, University of Nottingham

57

Frequency Domain Processing

Examples