1 pb. camera model calibration separation (int/ext) pose don’t get lost! what are we doing?...

14
1 camera model calibration separation (int/ext) ’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras Calibrated cameras Projective geometry Euclidean geometry Classical (Euclidean) tools

Upload: aubrey-blankenship

Post on 17-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

1

pb. camera model calibration separation (int/ext) pose

Don’t get lost! What are we doing?

Projective geometry Numerical tools

Uncalibrated cameras Calibrated cameras

Projective geometry Euclidean geometry

Classical (Euclidean) tools

Page 2: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

2

First application: camera pose estimation

• 3-point algebraic method

• 4 coplanar points linear method

Two most popular methods:

In vision, robotics, virtual reality, …

Pose estimation = extrinsic calibration = navigation by reference =where is the camera? = where am I in the scene?

Page 3: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

3

Pose estimation = calibration of only extrinsic parameters

33ii , KXu• Given

• Estimate R and t

Page 4: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

4

3-point algebraic method

• First convert pixels u into normalized points x by knowing the intrinsic parameters

• Write down the fundamental equation:

• Solve this algebraic system to get the point distances first

• Compute a 3D transformation

222 cos2 ijjiijji dxxxx

3 reference points == 3 beacons

Page 5: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

5

X

x

O

X’

x’

Fundamental euclidean geometric constraint:

Page 6: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

6

Solving the algebraic system by elimination:

• (using a symbolic computation software (Maple or Mathematica))• using … our hands

a polynomial of degree m and a polynomial of degree n leads to a polynomial of degree m*n

Page 7: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

7

given 3 corresponding 3D points:

3D transformation estimation

• Compute the centroids as the origin• Compute the scale • (compute the rotation by quaternion)• Compute the rotation axis• Compute the rotation angle

Page 8: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

8

nvv 2 aroundtorotatedis1

v

v’

n

nvvvvvv 21212 ,1

)()( 1 212 vvnvv k

Geometry of 3D rotation about an axis with angle theta

Page 9: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

9

k

matrixsymmetricantitheiswhere

/

,[*]

,][ 1

nx

vvxvv 212

2 equations for 3 unknowns, so two vectors are needed!

Page 10: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

10

Rotation axis is obtained, but not yet the angle …

vv

vvv parallel

vv

vv

2tan

Page 11: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

11

Linear pose estimation from 4 coplanar points

• (Projective method based on a homography) (Similar to plane-based calibration)

• Vector based (or affine geometry) method

Page 12: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

12

O

A

B

CD

x_a

x_d

Page 13: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

13

DC,B,A,,,,),( dcbT

aaa vu uuuu

,..., ba xx

,..., bbaa dOBdOA xx

ACABAD

)()()(

OAOCOAOBOAOD

0

....

....

....

d

c

b

a

d

d

d

d

Page 14: 1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras

14

||||cos222 ABdddd baabba

Now we get only the ratios of the unknown distances, to fix the ratio,

bada 2

b

a

d

d