www.nr.no earthobs.nr.no temporal analysis of forest cover using a hidden markov model arnt-børre...
TRANSCRIPT
![Page 1: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/1.jpg)
www.nr.noearthobs.nr.no
Temporal Analysis of Forest Cover Using a Hidden Markov Model
Arnt-Børre Salberg and Øivind Due Trier
Norwegian Computing Center
Oslo, Norway
IGARSS 2011, July 27
![Page 2: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/2.jpg)
www.nr.noearthobs.nr.no
Outline
► Motivation
► Hidden Markov model ▪ Concept
▪ Class sequence estimation
▪ Transition probabilities, clouds, and atmosphere
► Application: Tropical forest monitoring
► Conclusion
![Page 3: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/3.jpg)
www.nr.noearthobs.nr.no
Introduction
► Time-series of images needed in order to detect changes of the spatial forest cover
► Time-series analysis requires methodology that ▪ handles the natural variability between in images ▪ overcome problems with cloud cover in optical
images (and missing data in Landsat-7)▪ handles atmospheric disturbances▪ does not propagate errors from one time instant to
the next
![Page 4: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/4.jpg)
www.nr.noearthobs.nr.no
Introduction: Change detection
► Naive▪ Simply create forest cover maps from two years,
and compare▪ Errors in both maps are added. Not a good
idea!
► Time series analysis▪ Model what is going on by using all available
images from the two years (and before, between, and after)
![Page 5: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/5.jpg)
www.nr.noearthobs.nr.no
Hidden Markov Model (HMM)
► HMM used to model each location on ground as being in one of the following classes:
= {forest, sparse forest, grass, soil}
► Markov property: P(t|t-1,…,1) = P(t|t-1)
![Page 6: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/6.jpg)
www.nr.noearthobs.nr.no
Hidden Markov Model (HMM)► Bayes rule for Markov models
► P(t|t-1) : class transition probability
class 1 class 2
P(1|1) P(2|1)
class 3
P(3|1)
![Page 7: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/7.jpg)
www.nr.noearthobs.nr.no
Class sequence estimation
► Two popular methods for finding the class sequence 1. Most likely class sequence
2. Minimum probability of class error
![Page 8: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/8.jpg)
www.nr.noearthobs.nr.no
Most likely class sequence (MLCS)
► Finds the class sequence that maximizes the likelihood
→maximum likelihood estimate
► The optimal sequence is efficiently found using the Viterbi-algorithm
![Page 9: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/9.jpg)
www.nr.noearthobs.nr.no
Viterbi algorithm
Forest
Sparseforest
Grass
Soil
Forest
Sparseforest
Grass
Soil
Possible states at time t
Possible states at time t+1
Most probable sequence of previous states for each state at time t
The best sequence ending at state c, given the observations
x1, …, xt
The probability of jumping from state c to
state k (this is dependent on the time interval)
The probability of observing the
actual observation, given that the state
is k
![Page 10: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/10.jpg)
www.nr.noearthobs.nr.no
Minimum probability of class error
► If we are interested in obtaining a minimum probability of error class estimate (at time instant t), the MLCS method is not optimal, but the maximum a posteriori (MAP) estimate is
► The MAP estimate at time instant t
► t found using the forward-backward algorithm
![Page 11: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/11.jpg)
www.nr.noearthobs.nr.no
Class transition probabilities
► Landsat: Minimum time interval between two subsequent acquisitions is 16 days
► Let P0(t=m|t=m’) = P0(m|m’) denote the class transition probability corresponding to 16 days
► Class transition probability for any 16·t interval
…in matrix form
![Page 12: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/12.jpg)
www.nr.noearthobs.nr.no
Clouds
► Clouds prevent us from observing the Earth’s surface
► Clouds may be handled using two different strategies1. Cloud screening and masking of cloud-contaminated
pixels as missing observations
2. Include a cloud class in the HMM modeling framework
…in this work we only consider strategy 1.
► Cloud screening performed using a SVM
![Page 13: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/13.jpg)
www.nr.noearthobs.nr.no
Data distributions, class transition probabilities, co-registration
► Landsat image data (band 1-5,7) modeled using class dependent multivariate Gaussian distributions
► Mean vector and covariance matrix estimated from training data
► Class transition probabilities assumed fixed▪ May be estimated from the data (e.g. Baum-
Welch)
► Precise co-registration needed
![Page 14: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/14.jpg)
www.nr.noearthobs.nr.no
Atmospheric disturbance
Ground surface reflectance
Atmosphere
Top of the atmospherereflectance
We apply a re-training methodology for handling image data variations (IGARSS’11, MO4.T05)
LEDAPS calibration (surface reflectance) will be investigated
![Page 15: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/15.jpg)
www.nr.noearthobs.nr.no
Landsat 5 TM images (166/63)Amani, Tanzania
1985-03-09 1986-08-191986-06-16 1986-10-06 1987-08-06
1995-02-17 1995-05-24 2008-06-12
2009-11-222009-11-06 2009-12-08
2009-07-01
2010-02-10
1995-02-01
![Page 16: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/16.jpg)
www.nr.noearthobs.nr.no
Results - Forest cover maps
16
2010-02-101995-02-171986-06-16
ForestSparse forest
SoilGrass
Worldview-2 2010-03-04
![Page 17: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/17.jpg)
www.nr.noearthobs.nr.no
Results - Forest cover change
17
2010-02-10
1995-02-171986-06-16 1995-02-011986-10-061986-08-19
2009-07-01 2009-11-22 2009-12-08 WV2 2010-03-25
![Page 18: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/18.jpg)
www.nr.noearthobs.nr.no
Landsat 5 TM images (227-062)Santarém, Brazil
1988-09-04 1989-08-22 1992-07-29 1993-05-29 1995-06-04
1996-07-08 2004-08-31 2005-07-01 2005-07-17 2006-08-05
2007-06-21 2008-06-23 2008-09-11 2009-07-12 2009-07-28
![Page 19: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/19.jpg)
www.nr.noearthobs.nr.no
Results - Forest cover mapsSantarém, Brazil
19
2008-06-231997-07-271986-07-29 2007-06-23
![Page 20: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/20.jpg)
www.nr.noearthobs.nr.no
Results - Forest cover change mapsSantarém, Brazil
20
2008-06-231997-07-271986-07-29 2007-06-23
![Page 21: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/21.jpg)
www.nr.noearthobs.nr.no
Multsensor possibilities
► Multitemporal observations from other sensors (e.g., radar) may naturally be modeled in the hidden Markov model▪ Only the sensor data distributions are needed, e.g.
► The multisensor images need to be geocoded to the same grid
21
matrixcoherency theis , class| ttZ kp ZZ
![Page 22: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/22.jpg)
www.nr.noearthobs.nr.no
Temporal forest cover sequence
► Multisensor Hidden Markov model
22
CLASSES tt-1 t+1
ytyt-2
t-2
yt yt+1yt-1
OpticalOptical
Optical OpticalSAR SAR
TIME
OBSERVATIONS
![Page 23: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/23.jpg)
www.nr.noearthobs.nr.no
Conclusions
► Time series analysis of each pixel based on a hidden Markov model
► Finds the most likely sequence of land cover classes
► Change detection based on classified sequence▪ Does not propagate errors since the whole sequence is classified
simultaneously.▪ Regularized by the transition probabilities.
► Handles cloud contaminated images
► Multisensor possibilities
23
![Page 24: Www.nr.no earthobs.nr.no Temporal Analysis of Forest Cover Using a Hidden Markov Model Arnt-Børre Salberg and Øivind Due Trier Norwegian Computing Center](https://reader036.vdocuments.us/reader036/viewer/2022070409/56649e955503460f94b99ce7/html5/thumbnails/24.jpg)
www.nr.noearthobs.nr.no
Acknowledgements
The experiment presented here was supported by a research grant from the Norwegian Space Centre.
24