![Page 1: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/1.jpg)
Single-view geometry
Odilon Redon, Cyclops, 1914
![Page 2: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/2.jpg)
Our goal: Recovery of 3D structure• Recovery of structure from one image is
inherently ambiguous
x
X?X?
X?
![Page 3: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/3.jpg)
Our goal: Recovery of 3D structure• Recovery of structure from one image is
inherently ambiguous
![Page 4: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/4.jpg)
Our goal: Recovery of 3D structure• Recovery of structure from one image is
inherently ambiguous
![Page 6: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/6.jpg)
Our goal: Recovery of 3D structure• We will need multi-view geometry
![Page 7: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/7.jpg)
Recall: Pinhole camera model
• Principal axis: line from the camera center perpendicular to the image plane
• Normalized (camera) coordinate system: camera center is at the origin and the principal axis is the z-axis
![Page 8: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/8.jpg)
)/,/(),,( ZYfZXfZYX
101
0
0
1
Z
Y
X
f
f
Z
Yf
Xf
Z
Y
X
Recall: Pinhole camera model
PXx
![Page 9: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/9.jpg)
Principal point
• Principal point (p): point where principal axis intersects the image plane
• Normalized coordinate system: origin of the image is at the principal point
• Image coordinate system: origin is in the corner• How to go from normalized coordinate system to image
coordinate system?
px
py
![Page 10: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/10.jpg)
)/,/(),,( yx pZYfpZXfZYX
Z
pZYf
pZXf
Z
Y
X
y
x
1
Principal point offset
principal point: ),( yx pp
px
py
101
0
0
Z
Y
X
pf
pf
y
x
![Page 11: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/11.jpg)
101
01
01
1Z
Y
X
pf
pf
Z
ZpYf
ZpXf
y
x
y
x
Principal point offset
1y
x
pf
pf
K calibration matrix 0|IKP
principal point: ),( yx pp
![Page 12: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/12.jpg)
111yy
xx
y
x
y
x
pf
pf
m
m
K
Pixel coordinates
mx pixels per meter in horizontal direction, my pixels per meter in vertical direction
Pixel size: yx mm
11
pixels/m m pixels
![Page 13: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/13.jpg)
C~
-X~
RX~
cam
Camera rotation and translation
• In general, the camera coordinate frame will be related to the world coordinate frame by a rotation and a translation
coords. of point in camera frame
coords. of camera center in world frame
coords. of a pointin world frame
• Conversion from world to camera coordinate system (in non-homogeneous coordinates):
![Page 14: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/14.jpg)
C~
-X~
RX~
cam
X10
C~
RR
1
X~
10
C~
RRXcam
XC~
R|RKX0|IKx cam ,t|RKP C~
Rt
Camera rotation and translation
Note: C is the null space of the camera projection matrix (PC=0)
![Page 15: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/15.jpg)
Camera parameters
• Intrinsic parameters• Principal point coordinates• Focal length• Pixel magnification factors• Skew (non-rectangular pixels)• Radial distortion
111yy
xx
y
x
y
x
pf
pf
m
m
K
tRKP
![Page 16: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/16.jpg)
Camera parameters
• Intrinsic parameters• Principal point coordinates• Focal length• Pixel magnification factors• Skew (non-rectangular pixels)• Radial distortion
• Extrinsic parameters• Rotation and translation relative to world coordinate system
tRKP
![Page 17: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/17.jpg)
Camera calibration
1****
****
****
Z
Y
X
y
x
XtRKx
Source: D. Hoiem
![Page 18: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/18.jpg)
Camera calibration
• Given n points with known 3D coordinates Xi and known image projections xi, estimate the camera parameters
? P
Xi
xi
![Page 19: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/19.jpg)
ii PXx
Camera calibration: Linear method
0PXx ii0
XP
XP
XP
1 3
2
1
iT
iT
iT
i
i
y
x
0
P
P
P
0XX
X0X
XX0
3
2
1
Tii
Tii
Tii
Ti
Tii
Ti
xy
x
y
Two linearly independent equations
![Page 20: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/20.jpg)
Camera calibration: Linear method
• P has 11 degrees of freedom• One 2D/3D correspondence gives us two linearly
independent equations• Homogeneous least squares: find p minimizing ||Ap||2
• Solution given by eigenvector of ATA with smallest eigenvalue• 6 correspondences needed for a minimal solution
0pA 0
P
P
P
X0X
XX0
X0X
XX0
3
2
1111
111
Tnn
TTn
Tnn
Tn
T
TTT
TTT
x
y
x
y
![Page 21: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/21.jpg)
Camera calibration: Linear method
• Note: for coplanar points that satisfy ΠTX=0,we will get degenerate solutions (Π,0,0), (0,Π,0), or (0,0,Π)
0Ap0
P
P
P
X0X
XX0
X0X
XX0
3
2
1111
111
Tnn
TTn
Tnn
Tn
T
TTT
TTT
x
y
x
y
![Page 22: Single-view geometry Odilon Redon, Cyclops, 1914](https://reader035.vdocuments.us/reader035/viewer/2022062219/551aa3fa550346856e8b46b0/html5/thumbnails/22.jpg)
Camera calibration: Linear method
• Advantages: easy to formulate and solve• Disadvantages
• Doesn’t directly tell you camera parameters• Doesn’t model radial distortion• Can’t impose constraints, such as known focal length and
orthogonality
• Non-linear methods are preferred• Define error as squared distance between projected points
and measured points• Minimize error using Newton’s method or other non-linear
optimization
Source: D. Hoiem