3.1 rigid global 4pcs
DESCRIPTION
Rigid 4 PCSTRANSCRIPT
![Page 1: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/1.jpg)
Global Shape Matching: 4PCS
Subsection Title
4-Points Congruent Sets for Robust Pairwise Surface Registration
Niloy J. Mitra
![Page 2: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/2.jpg)
Global Shape Matching: 4PCS
Correspondence Problem ClassificationHow many meshes?
• Two: Pairwise registration
• More than two: multi-view registration
Initial registration available?• Yes: Local optimization methods
• No: Global methods
Class of transformations?• Rotation and translation: Rigid-body
• Non-rigid deformations
![Page 3: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/3.jpg)
Global Shape Matching: 4PCS
Problem Statement
Given: Two models
![Page 4: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/4.jpg)
Global Shape Matching: 4PCS
Problem Statement
Goal: Automa'cally align the models
![Page 5: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/5.jpg)
Global Shape Matching: 4PCS
Why is this Hard?
Given: Two scans-‐ corrupted with noise and outliers
- in arbitrary ini)al poses with unknown overlap
![Page 6: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/6.jpg)
(1− p) (1− p)k Prob. of success: 1− (1− p)k
Global Shape Matching: 4PCS
RANSAC for Line Fitting
Observations:• Problem can be solved by a small number of (correct) points, e.g., 2 in line fitting• Easy to verify solution (error measurement)
Let p be the probability of (random) picking a correct pointProbability of getting correct result in k tries
![Page 7: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/7.jpg)
Global Shape Matching: 4PCS
Alignment Approach
P Q
![Page 8: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/8.jpg)
Global Shape Matching: 4PCS
Alignment Approach
P
Q
![Page 9: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/9.jpg)
Global Shape Matching: 4PCS
Alignment Approach
P Q
![Page 10: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/10.jpg)
Global Shape Matching: 4PCS
Alignment Approach
P
Q
![Page 11: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/11.jpg)
Global Shape Matching: 4PCS
Alignment Approach
![Page 12: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/12.jpg)
Global Shape Matching: 4PCS
Alignment Approach
guess and verify
P
Q
![Page 13: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/13.jpg)
Global Shape Matching: 4PCS
Partial Matching
P Q
![Page 14: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/14.jpg)
Global Shape Matching: 4PCS
Aligning with Feature Points (FP)
![Page 15: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/15.jpg)
Global Shape Matching: 4PCS
Aligning with Feature Points
![Page 16: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/16.jpg)
Global Shape Matching: 4PCS
Aligning with Feature Points
![Page 17: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/17.jpg)
Global Shape Matching: 4PCS
Why not Denoise Scans?
de-‐noise,compute FP-‐s,align
align with 4PCS,de-‐noise
![Page 18: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/18.jpg)
A pair of triples (from P and Q) is enough to uniquely define a rigid transform O(n3)
Surprisingly, a special set of 4-points, congruent sets, makes the problem simpler O(n2)
Global Shape Matching: 4PCS
Key Observation
![Page 19: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/19.jpg)
Global Shape Matching: 4PCS
4-Points Congruent Sets
Few matches output sensitive algorithm
Can be efficiently extracted
![Page 20: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/20.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
![Page 21: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/21.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
![Page 22: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/22.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
![Page 23: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/23.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent U = {U1, U2, …}
![Page 24: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/24.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent U1
![Page 25: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/25.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent U2
![Page 26: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/26.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent U3
![Page 27: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/27.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent U4
![Page 28: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/28.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
B1
FindCongruent Uj
retain the best transform (T1)
![Page 29: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/29.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
Bi
FindCongruent Uj
Ti
RANSAC iteraHons
![Page 30: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/30.jpg)
Global Shape Matching: 4PCS
RANSAC iteraHons
4PCS Algorithm
P
Q
SelectCoplanarBase
Bi
FindCongruent Uj
Ti
FindCongruent
SelectCoplanarBase
![Page 31: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/31.jpg)
Global Shape Matching: 4PCS
Random Sampling
P
Q
SelectCoplanarBase
Bi
FindCongruent Uj
Ti
verificaHon
subsam
pling
RANSAC iteraHons
![Page 32: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/32.jpg)
Global Shape Matching: 4PCS
FindCongruent
![Page 33: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/33.jpg)
A pair of triples (from P and Q) is enough to uniquely define a rigid transform O(n3)
Surprisingly, a special set of 4-points, congruent sets, makes the problem simpler O(n2)
Global Shape Matching: 4PCS
Key Observation
![Page 34: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/34.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
![Page 35: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/35.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
![Page 36: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/36.jpg)
Global Shape Matching: 4PCS
Affine Invariance
4 coplanar points
P
![Page 37: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/37.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
![Page 38: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/38.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
![Page 39: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/39.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
Q
![Page 40: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/40.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
Q
![Page 41: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/41.jpg)
Global Shape Matching: 4PCS
Affine Invariance
P
Q
![Page 42: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/42.jpg)
Global Shape Matching: 4PCS
Affine Invariance
Q
![Page 43: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/43.jpg)
Global Shape Matching: 4PCS
P
Extracting Congruent 4-points
{a,b, c,d}→ e, r1, r2
a�,b�, r1 → e�
r1 = �a�−e���a�−b��
r1
r2
Q
![Page 44: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/44.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 45: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/45.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 46: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/46.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 47: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/47.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 48: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/48.jpg)
Global Shape Matching: 4PCS
What if e1 ≠ e2 ?
typical scenario
![Page 49: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/49.jpg)
Global Shape Matching: 4PCS
What if e1 = e2 ?
congruent 4-‐points!
typical scenario
![Page 50: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/50.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 51: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/51.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 52: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/52.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 53: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/53.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 54: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/54.jpg)
Global Shape Matching: 4PCS
Extracting Congruent 4-points
![Page 55: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/55.jpg)
Global Shape Matching: 4PCS
FindCongruent
For all the points arising using r1 build an approximate range-tree (ANN)
For all the points due to r2, quickly lookup for neighbors using range-tree
![Page 56: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/56.jpg)
Global Shape Matching: 4PCS
Rigid Transformation
Euclidean distances are preserved
a
b
(q1,q2) �q1 − q2� ≈ �a− b�
![Page 57: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/57.jpg)
Global Shape Matching: 4PCS
SelectCoplanarBase
![Page 58: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/58.jpg)
Global Shape Matching: 4PCS
4PCS Algorithm
P
Q
SelectCoplanarBase
Bi
FindCongruent U3
Ti
RANSAC iteraHons
FindCongruent
SelectCoplanarBase
![Page 59: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/59.jpg)
Global Shape Matching: 4PCS
SelectCoplanarBase
Select 3 points (from P) at random 4th point to ensure (approx) coplanarity
Overlap amount decreasing guesses f = 1, 0.5, 0.25, …
![Page 60: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/60.jpg)
Global Shape Matching: 4PCS
Results
![Page 61: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/61.jpg)
Global Shape Matching: 4PCS
Effect of Noise
σ = 0.5σ = 0.5 σ = 2.0 σ = 4.0
![Page 62: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/62.jpg)
Global Shape Matching: 4PCS
Why not Denoise Scans?
de-‐noise,compute FP-‐s,align
align with 4PCS,de-‐noise
![Page 63: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/63.jpg)
Global Shape Matching: 4PCS
Effect of Outliers
10 % 20 % 40 %
![Page 64: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/64.jpg)
Global Shape Matching: 4PCS
Varying Overlap
80 % 70 % 60 % 50 % 40 %
![Page 65: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/65.jpg)
Global Shape Matching: 4PCS
Varying Overlap
80 % 70 % 60 % 50 % 40 %
![Page 66: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/66.jpg)
Global Shape Matching: 4PCS
Building Facade
![Page 67: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/67.jpg)
Global Shape Matching: 4PCS
Jerusalem Scan
![Page 68: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/68.jpg)
Global Shape Matching: 4PCS
Jerusalem Scan
![Page 69: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/69.jpg)
Global Shape Matching: 4PCS
Try It
hLp://graphics.stanford.edu/~niloy/research/fpcs/fpcs_sig_08.html
applicaHon code
![Page 70: 3.1 Rigid Global 4PCS](https://reader033.vdocuments.us/reader033/viewer/2022051117/5695d1da1a28ab9b02982993/html5/thumbnails/70.jpg)
Global Shape Matching: 4PCS
Reference
4-‐points Congruent Sets for Robust Surface RegistraHon, Dror Aiger, Niloy J. Mitra, Daniel Cohen-‐Or,SIGGRAPH 2008.