motion tracking of sea ice with sar satellite...
TRANSCRIPT
![Page 1: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/1.jpg)
Motion tracking of sea ice with SAR satellite data
Denis Demchev, Researcher at AARI, NIERSC
![Page 2: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/2.jpg)
Outline
Description of sea ice feature tracking algorithm
Comparison with manual drift vectors, buoys and DTU drift product from S1a
Examples with S1a and RS2 for «gridded» version of the algorithm
SIRS meeting | 24 May 2016 2
![Page 3: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/3.jpg)
An algorithm is proposed for sea ice drift retrieval from sequential satellite synthetic aperture radar (SAR) imageries.
State-of-the-art image processing methods from Computer Vision (CV) are becoming actual for automatic SAR remote sensing data analysis.
Keypoints (KP) is used for feature tracking in CV. KP is a point which could be tracked from image to image.
The algorithm has to be robust against speckle noise, gray level variance and ice floe rotation. This could be solved by keypoints detection using Scale Invariant Feature Transform (SIFT). The modified version of SIFT is adopted for satellite SAR data including Sentinel-1a.
Keypoints
Descriptors
Detect keypoints
Describe each region
around a keypoint as a
feature vector
(descriptor)
Compare descriptors
by descriptor distance or similarity
SIRS meeting | 24 May 2016 3
Basic idea
![Page 4: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/4.jpg)
Method - create a Gaussian pyramid - Keypoint localization (local extrema in the fields of the pyramids) (a) frame around an interest point, oriented according to the dominant gradient direction; (b) an 8 bin histogram over the direction of the gradient in a part of the grid; (c) histograms are extracted in each grid location; (d) the histograms are concatenated to form one long feature vector.
SIRS meeting | 24 May 2016 4
![Page 5: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/5.jpg)
Method
SIRS meeting | 24 May 2016 5
Keypoints detection
Keypoints description
Matching
![Page 6: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/6.jpg)
Modifications
SIRS meeting | 24 May 2016 6
The benefit of Gaussian blurring is the suppression of noise, but relevant image structures are blurred and drift away from their locations
A good solution to make the blurring locally adaptive, yielding the blurring of noise, while retaining details
Replace Gaussian scale space with non-linear scale space using anisotropic diffusion proposed by Perona and Malik [1990]
![Page 7: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/7.jpg)
Method
SIRS meeting | 24 May 2016 7
1. The classic nonlinear diffusion equation is: where div and 𝛻𝛻 are respectively the divergence and gradient operators, and 𝐿𝐿 is the image luminance;
2. A conductivity function 𝑐𝑐 make the diffusion adaptive to the local image structure.
Time 𝑡𝑡 is the scale parameter, and larger values lead to simpler image representations. In anisotropic diffusion the image gradient magnitude controls the diffusion at each scale level. This way, the conductivity function 𝑐𝑐 is defined as:
𝛻𝛻𝐿𝐿𝜎𝜎 is the gradient of a Gaussian smoothed version of the original image L;
3. We use one of the two conductivity function proposed by Perona and Malik:
The parameter λ is the contrast factor that controls the level of diffusion. It determines which edges have to be enhanced or kept and which ones have to be cancelled.
![Page 8: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/8.jpg)
Gaussian scale-space versus non-linear diffusion scheme
SIRS meeting | 24 May 2016 8
Gaussian kernel
Non-linear diffusion scheme
Blurring
![Page 9: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/9.jpg)
Experiments
SIRS meeting | 24 May 2016 9
![Page 10: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/10.jpg)
NIFT Validation
Buoy # 784540 Example for: 01 March, 13GMT – 03 March, 15GMT, 2016
SIRS meeting | 24 May 2016 10
![Page 11: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/11.jpg)
Experiment #1
SIRS meeting | 24 May 2016 11
Ice drift for 2016-03-31 / 2016-04-02 from HH Sentinel-1a
![Page 12: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/12.jpg)
Experiment #1
SIRS meeting | 24 May 2016 12
PROPOSED SIFT ORB
Sea Ice Drift field
Start points distribution
![Page 13: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/13.jpg)
Experiment #1
SIRS meeting | 24 May 2016 13
PROPOSED SIFT ORB
Start points
Data density
![Page 14: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/14.jpg)
Experiment #1
SIRS meeting | 24 May 2016 14
![Page 15: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/15.jpg)
Experiment #2
SIRS meeting | 24 May 2016 15
Ice drift for 2016-03-02 / 2016-03-03 from HV Sentinel-1a
![Page 16: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/16.jpg)
Experiment #2
SIRS meeting | 24 May 2016 16
PROPOSED SIFT ORB
Sea Ice Drift field
Start points distribution
![Page 17: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/17.jpg)
Experiment #2
SIRS meeting | 24 May 2016 17
PROPOSED SIFT ORB
Start points
Data density
![Page 18: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/18.jpg)
Experiment #2
SIRS meeting | 24 May 2016 18
![Page 19: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/19.jpg)
Comparison with MCC (Exp. #3)
SIRS meeting | 24 May 2016 19
Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a
Visualization of vectors, retrieved with proposed (a) and MCC (b) algorithms for experiment 3. At (a) and (b) highlighted box, scaled at (c): MCC vectors given with black arrows, AKAZE vectors given with white arrows.
a b c
![Page 20: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/20.jpg)
Comparison with MCC (Exp. #4)
SIRS meeting | 24 May 2016 20
Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a
Visualization of vectors, retrieved with proposed (a) and MCC (b) algorithms for experiment 4. At (a) and (b) highlighted box, scaled at (c): MCC vectors given with black arrows, AKAZE vectors given with white arrows.
a b c
![Page 21: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/21.jpg)
Comparison with MCC
SIRS meeting | 24 May 2016 21
![Page 22: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/22.jpg)
Comparison with DTU drift product
RMS difference to reference data MCC: ~ 421 m/day
PROPOSED: ~238 m/day
Higher spatial resolution of ice drift product
Proposed algorithm could catch ice motion features at scale of less than 1 km using initial data with spatial
resolution of 100 m
SIRS meeting | 24 May 2016 22
![Page 23: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/23.jpg)
Gridded Product
a new «gridded» version of the algorithm is developed
based on optimization of feature point detection within image blocks
gridded product of 1 km resolution from 100m initial data
tested with Sentinel-1a/Radarsat-2
SIRS meeting | 24 May 2016 23
![Page 24: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/24.jpg)
Radarsat2 example
SIRS meeting | 24 May 2016 24
![Page 25: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/25.jpg)
Sentinel-1a example
SIRS meeting | 24 May 2016 25
![Page 26: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/26.jpg)
Publications and reports
First time reported at IICWG’2013: ftp://sidads.colorado.edu/pub/projects/noaa/iicwg/IICWG-2013/Demchev_Ice_Drift_Retrieval_Algorithm_From_SAR.pdf Sea ice drift tracking from SAR using Accelerated-KAZE
features. Demchev et all. Near submitting in Journal of Applied Remote Sensing (JARS)
SIRS meeting | 24 May 2016 26
![Page 27: Motion tracking of sea ice with SAR satellite data123userdocs.s3-website-eu-west-1.amazonaws.com/d/0... · Ice drift for 2016-05-02 / 2016-05-03 from HV Sentinel-1a Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062923/5f0b2f817e708231d42f450d/html5/thumbnails/27.jpg)
Thank you for your attention!
SIRS meeting | 24 May 2016 27