dataanalysis: statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf ·...
TRANSCRIPT
![Page 1: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/1.jpg)
Data analysis:Statistical principals andcomputational methods
IntroductionDmitrij Schlesinger, Carsten Rother
SS2014, 04.06.2014
![Page 2: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/2.jpg)
Part 3
1. Statistics (Ingo Röder)2. Machine Learning (Lars Kaderali)3. Structural models (Dmitrij Schlesinger, Carsten Rother)04.06: Markov chains – the model, Dynamic Programming18.06: Energy Minimization – search techniques25.06: Energy Minimization – LP-relaxation02.07: Statistical inference for MRF-s, sampling techniques09.07: Statistical Learning – Maximum Likelihood for MRF-s16.07: Structural SVM
Structural Models:Data that consists of several parts, and not only the partsthemselves contain information, but also the way in which theparts belong together.
Statistical principals and computational methods: Introduction 04.06.2014 2
![Page 3: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/3.jpg)
Example – Segmentation
Original
A possiblesegmentation
r r r r
r
r
Data termsCompactness terms
PenaltyZero
k = 3: Shadow
k = 2: Forest
k = 1: Field
Dissimilarity measure
Observed features
Statistical principals and computational methods: Introduction 04.06.2014 3
![Page 4: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/4.jpg)
Example – Stereo
Y
Z
X
pl = Tl(X, Y, Z) pr = Tr(X, Y, Z)
k = 1
k = 2
. . .
k = kmax
r r r r
r
r
e e
e
e
e
Statistical principals and computational methods: Introduction 04.06.2014 4
![Page 5: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/5.jpg)
Example – Actve Graph MatchingAutomatic Joint Segmentaton and Annotaton of C. Elegans
Input 3D volume MatchingStatistical principals and computational methods: Introduction 04.06.2014 5
![Page 6: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/6.jpg)
Markov Random Fields (simplified)
Statistical principals and computational methods: Introduction 04.06.2014 6
![Page 7: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/7.jpg)
Markov Random Fields (simplified)Graph G = (V, E), K – label set, F – “observations” set,y ∈ Y : V → K – labeling, x ∈ X : V → F – observationAn elementary event is a pair (x, y), the (negative) energy:
E(x, y) =∑ij∈E
ψij(yi, yj) +∑i∈V
ψi(xi, yi)
The joint probability:
p(x, y) = 1Z
exp[−E(x, y)
]Special case – Markov Chains:
Statistical principals and computational methods: Introduction 04.06.2014 7
![Page 8: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/8.jpg)
Some popular MRF-s
... of second order over the pixel grid, 4-neighborhood(because simple) – segmentation, denoising, deconvolution,stereo, motion fields etc.
... with continuous label spaces – denoising, stereo
... with dense neighborhood structure – shape modeling(e.g. curvature), segmentation
... of higher order – all the stuff above
Conditional Random Fields (CRF) – MRF-s that modelposterior distributions of labellings instead of the joint ones
Statistical principals and computational methods: Introduction 04.06.2014 8
![Page 9: Dataanalysis: Statisticalprincipalsand ...ds24/lehre/spcm_ss_2014/sp_00_intro.pdf · Example–Stereo Y Z X pl = Tl(X, Y, Z) pr = Tr(X, Y, Z) k = 1 k = 2 k = kmax rrrr r r ee e e](https://reader030.vdocuments.us/reader030/viewer/2022040620/5f3025f58b99e123af19330d/html5/thumbnails/9.jpg)
Organization
Seminars: assignments on the board,own solutions (ideas, propositions etc.) are expected !!!
Literature:– Christopher M. BishopPattern Recognition and Machine Learninghttp://research.microsoft.com/en-us/um/people/cmbishop/prml/
– Sebastian Nowozin and Christoph H. LampertStructured Prediction and Learning in Computer Visionhttp://www.nowozin.net/sebastian/cvpr2011tutorial/
Scripts:http:
//wwwpub.zih.tu-dresden.de/~ds24/lehre/spcm_ss_2014/spcm_ss_2014.html
Statistical principals and computational methods: Introduction 04.06.2014 9