polarimetric imaging sensors for surveillance navigation and communications howard schultz and...

19
Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel versity of Massachusetts, Aerial Imaging and Remote Sensing Laborato [email protected], [email protected] Chris Zappa and Michael Banner Columbia University, Lamont-Doherty Earth Observatory [email protected], [email protected] Office of Naval Research January 3, 2007

Post on 20-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Polarimetric Imaging Sensors for Surveillance Navigation and Communications

Howard Schultz and Andrés Corrada-EmmanuelUniversity of Massachusetts, Aerial Imaging and Remote Sensing Laboratory

[email protected], [email protected]

Chris Zappa and Michael BannerColumbia University, Lamont-Doherty Earth [email protected], [email protected]

Office of Naval ResearchJanuary 3, 2007

Page 2: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Long Term Goals

• Develop passive remote sensing techniques for studying the dynamics of the upper ocean

• View the surface environment from a submerged platform– Polarimetric Periscope– Uplink/downlink Communications

Page 3: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Optical Flattening

Page 4: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Motivation

• View the above-surface environment from below the surface

• Objects in a scene taken from underwater are naturally blurred by wave motion– Image sharpening– wave estimation algorithm

• Wave estimates are not yet accurate enough to substantially improve the reconstructed images above the surface beyond what can be achieved assuming a flat surface.

Page 5: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Optical Flattening

• Use information about the 2D slope field of the ocean surface to remove image distortion -- What would an image taken through the ocean surface look like if there were no waves?

• Real-time processing

Page 6: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Projective Image Formation Model

Imaging Array

Exposure Center

Observation RaysAir

Water

Page 7: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Optical Flattening Algorithm*

• Collect polarimetric images

• Recover the 2D surface slope field

• Compute the refraction for each rays as it passes through the air-sea interface

• Create an undistorted image (sort on the direction of the rays in air)

*Patent Pending Process, University of Massachusetts, Amherst

Page 8: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Degree of Linear Polarization (DoLP) vs. Incidence angle

Incidence Angle (degrees)0 10 20 30 40 50 60 70 80 90

1.0

0.8

0.6

0.4

0.2

0.0

Reflection

Refraction

I

UQDoLP

22

Page 9: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Ray tracing image formation modelA lens maps incidence angle θ to image position X

Lens

Imaging Array

X

θ

Page 10: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Ray tracing image formation modelA lens maps incidence angle θ to image position X

X

θ

Lens

Imaging Array

Page 11: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Ray tracing image formation modelA lens maps incidence angle θ to image position X

X

Lens

Imaging Array

Page 12: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Ray tracing image formation modelA lens maps incidence angle θ to image position X

X

θ

Lens

Imaging Array

Page 13: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Ray tracing image formation modelA lens maps incidence angle θ to image position X

X

θ

Lens

Imaging Array

Page 14: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Refraction

Air

Water

Distorted Image Point

Page 15: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Refraction

Air

Water

Distorted Image Point

Page 16: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

UndistortionCompensating for Refraction

Undistorted Image PointDistorted Image Point

Air

Water

Air

Page 17: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

UndistortionCompensating for Refraction

Distorted Image Point Undistorted Image Point

Air

Water

Air

Page 18: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial

Implementation Considerations

• Uses only one polarimetric camera• Exploit the natural time scale separation

tsky > tobjjects > twaves > tshutter to estimate the polarization distribution of the sky radiance

• Real-time requires a functional approximation between the inferred incoming Stokes vector, the observed scattered Stokes vector and surface slope (Kattawar, 1994; Voss and Fry, 1984; Sabbah and Shashar, 2006; current effort in RaDyO).

• Statistical techniques will always be needed to sharpen final image.

• Requires a precise motion package

Page 19: Polarimetric Imaging Sensors for Surveillance Navigation and Communications Howard Schultz and Andrés Corrada-Emmanuel University of Massachusetts, Aerial