nondestructive methods for recovering the spatial- temporal structure of ocean surface waves &
DESCRIPTION
Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves & Seeing Through Waves. Howard Schultz < [email protected] > Chris J. Zappa, Michael L. Banner, Larry Pezzaniti. August 2010. Outline. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/1.jpg)
Nondestructive Methods for Recovering the Spatial-Temporal Structure of Ocean Surface Waves
&Seeing Through Waves
Howard Schultz <[email protected]>Chris J. Zappa, Michael L. Banner, Larry Pezzaniti
August 2010
![Page 2: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/2.jpg)
Outline• Why recover the 2-D spatial-temporal structure of the
ocean surface?• Requirements• Why use a passive optical technique• What is polarimetry?• What is the Polarimetric Slope Sensing (PSS) technique?• Build and Test an Imaging Polarimeter for Ocean Apps. • Recent Experiment and Results• Optical Flattening• Seeing Through Waves
![Page 3: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/3.jpg)
• Why recover the 2-D structure of the ocean surface?– Characterize small scale wave dynamics– Air-sea interactions occur at short wavelengths– Non-linear interaction studies require phase-resolved surface topography– Enable through-the-wave imaging
• Requirements– Spatial resolution (resolve capillary waves) ~ 1mm– Temporal resolution ~60Hz sampling rate– Shutter speed < 1 msec
• Why use a passive optical technique– Probes disturb the air-sea interaction– Radar do not produce phase-resolved surfaces– Active techniques are complex and expensive
![Page 4: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/4.jpg)
What is polarimetry?
• Light has 3 basic qualities• Color, intensity and polarization• Humans do not see polarization
![Page 5: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/5.jpg)
Linear Polarization
http://www.enzim.hu/~szia/cddemo/edemo0.htm
![Page 6: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/6.jpg)
Circular Polarization
![Page 7: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/7.jpg)
• A bundle of light rays is characterized by intensity, a frequency distribution (color), and a polarization distribution
• Polarization distribution is characterized by Stokes parametersS = (S0, S1, S2, S3)
• The change in polarization on reflection or scattering is governed by Muller Calculus
SOUT = M SIN
• Where M contains information about the shape and material properties of the scattering media
• The goal: Measure SOUT and SIN and infer the parameters of M
What is polarimetry?
Amount of circular polarizationOrientation and degree of linear polarizationIntensity
Incident LightMuller MatrixScattered Light
![Page 8: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/8.jpg)
What is the Polarimetric Slope Sensing (PSS) technique?
• Use the change in polarization of reflected skylight to infer the 2D surface slope, , for every pixel in the imaging polarimeter’s field-of-view
€
∂z /∂x and ∂z /∂y
![Page 9: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/9.jpg)
What is the Polarimetric Slope Sensing (PSS) technique?
![Page 10: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/10.jpg)
How well does the PSS technique work?
• Conduct a feasibility study– Rented a linear imaging polarimeter– Laboratory experiment
• setup a small 1m x 1m wavetank• Used unpolarized light• Used wire gauge to simultaneously measure wave profile
– Field experiment• Collected data from a boat dock• Overcast sky (unpolarized)• Used a laser slope gauge
![Page 11: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/11.jpg)
![Page 12: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/12.jpg)
Looking at 90 to the wavesLooking at 45 to the wavesLooking at 0 to the waves
![Page 13: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/13.jpg)
![Page 14: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/14.jpg)
Slope in Degrees
X-Component
Y-Component
![Page 15: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/15.jpg)
X-Component Y-Component
Slope in Degrees
![Page 16: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/16.jpg)
![Page 17: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/17.jpg)
Build and Test an Imaging Polarimeter for Oceanographic Applications
–Funded by an ONR DURIP–Frame rate 60 Hz–Shutter speed as short as 10 μsec–Measure all Stokes parameters–Rugged and light weight–Deploy in the Radiance in a Dynamic
Ocean (RaDyO) research initiativehttp://www.opl.ucsb.edu/radyo/
![Page 18: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/18.jpg)
Motorized Stage12mm travel5mm/sec max speed
ObjectiveAssembly
Polarizing beamsplitterassembly
Camera 1(fixed)
Camera 2
Camera 3Camera 4
![Page 19: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/19.jpg)
![Page 20: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/20.jpg)
FLIP INSTRUMENTATION SETUPScanning Altimeters
Infrared Camera
Air-Sea Flux Package
Polarimeter
Visible Camera
![Page 21: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/21.jpg)
Sample Results
• A sample dataset from the Santa Barbara Channel experiment was analyzed
• Video 1 shows the x- and y-slope arrays for 1100 frames• Video 2 shows the recovered surface (made by
integrating the slopes) for the first 500 frames• A statistical comparison between our results and
published results is given as well
![Page 22: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/22.jpg)
X and Y Slope Video
![Page 23: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/23.jpg)
Reconstructed Surface Video
![Page 24: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/24.jpg)
Preliminary Polarimeter Comparison with Cox and Munk
![Page 25: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/25.jpg)
Seeing Through Waves
• Sub-surface to surface imaging• Surface to sub-surface imaging
![Page 26: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/26.jpg)
Optical Flattening
![Page 27: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/27.jpg)
Optical Flattening
• Remove the optic distortion caused by surface waves to make it appear as if the ocean surface was flat– Use the 2D surface slope field to find the
refracted direction for each image pixel– Refraction provides sufficient information to
compensate for surface wave distortion– Real-time processing
![Page 28: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/28.jpg)
Image FormationSubsurface-to-surface
Imaging Array
Exposure Center
Observation RaysAir
Water
![Page 29: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/29.jpg)
Image Formationsurface-to-subsurface
Imaging Array
Exposure Center
Air
Water
Imaging Array
Exposure Center
![Page 30: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/30.jpg)
Optical Flattening Algorithm
• Collect polarimetric images• Compute the Stokes parameters for each pixel• Recover the 2D surface slope field• Compute the refraction for each rays as it
passes through the air-sea interface• Create an undistorted image
![Page 31: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/31.jpg)
Un-distortionA lens maps incidence angle θ to image position X
Lens
Imaging Array
X
θ
![Page 32: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/32.jpg)
X
θ
Lens
Imaging Array
Un-distortionA lens maps incidence angle θ to image position X
![Page 33: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/33.jpg)
X
Lens
Imaging Array
Un-distortionA lens maps incidence angle θ to image position X
![Page 34: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/34.jpg)
X
θ
Lens
Imaging Array
Un-distortionA lens maps incidence angle θ to image position X
![Page 35: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/35.jpg)
X
θ
Lens
Imaging Array
Un-distortionA lens maps incidence angle θ to image position X
![Page 36: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/36.jpg)
Distorted Image Point
Image array
Un-distortionUse the refraction angle to “straighten out” light
rays
Air
Water
![Page 37: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/37.jpg)
Air
Water
Distorted Image PointUn-distorted Image Point
Image array
Un-distortionUse the refraction angle to “straighten out” light
rays
![Page 38: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/38.jpg)
Real-time Un-Distortion• The following steps are taken Real-time
Capable– Collect Polarimetric Images ✔– Convert to Stokes Parameters ✔– Compute Slopes (Muller Calculus) ✔– Refract Rays (Lookup Table) ✔– Remap Rays to Correct Pixel ✔
![Page 39: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/39.jpg)
Detecting Submerged Objects“Lucky Imaging”
• Use refraction information to keep track of where each pixel (in each video frame) was looking in the water column
• Build up a unified view of the underwater environment over several video frames
• Save rays that refract toward the target area• Reject rays that refract away from the target
area
![Page 40: Nondestructive Methods for Recovering the Spatial- Temporal Structure of Ocean Surface Waves &](https://reader036.vdocuments.us/reader036/viewer/2022062521/56816668550346895dd9fcf6/html5/thumbnails/40.jpg)
For more information contactHoward SchultzUniversity of MassachusettsDepartment of Computer Science140 Governors DriveAmherst, MA 01003Phone: 413-545-3482Email: [email protected]