video mirror camera - university of...

20
Illustration of vision system for visually guided terrain following and landing (not to scale). The vision system is shown on an enlarged scale relative to the aircraft in order to clarify its configuration. Mirror Video camera Ground plane

Upload: others

Post on 01-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Illustration of vision system for visually guided terrain following and landing (not to scale). The vision system is shown on an enlarged scale relative to the aircraft in order to clarify its configuration.

Mirror Video camera

Ground plane

Page 2: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Design of terrrain-following mirror profile

Page 3: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane
Page 4: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

•  Removes perspective distortion •  Scales down image motion •  Defines a “collision free” cylinder

Digitally remapped version

Centre of mirror

Imaging properties

Work with Saul Thurrowgood and Dean Soccol

Page 5: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane
Page 6: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Flight test -1

Work in progress with Saul Thurrowgood and Dean Soccol

Page 7: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Vision system

Optic axis

Camera 1 Camera 2 Mirror 1 Mirror 2

Surface of constant disparity

Ground plane

Collision-free cylinder

Moore, Thurrowgood, Bland, Soccol, Srinivasan (2009)

Page 8: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Front camera

Coaxial rear camera Vision system

Vision system

Translocated engine/propeller assembly

Page 9: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Closed loop flight test

Front camera view Field view Moore, Thurrowgood, Bland, Soccol, Srinivasan (2009)

Page 10: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Auto Auto

Page 11: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Image from Goodman (2000)

Visual horizon sensing

Page 12: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

IEye Bee Eye

Design of I-Eye (right) to emulate the functionality of a honeybee eye (above)

Thurrowgood, Moore, Bland, Soccol

Page 13: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane
Page 14: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Test of horizon-based attitude sensing system

Thurrowgood, Soccol, Moore, Bland, Srinivasan (2010)

Page 15: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Flight test: Horizon-based closed-loop control of roll and pitch

‘Manual’: Human pilot controls attitude ‘Automatic’: Horizon-sensing autopilot regulates attitude

(Roll: +40.0 deg; Pitch: -2.0 deg)

Thurrowgood, Soccol, Moore, Bland, Srinivasan (2009)

Page 16: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Thurrowgood, Soccol, Moore, Bland, Srinivasan (2011)

Extreme maneuver accomplished autonomously by controlling the position of the horizon in the I-Eye vision system Example 1

Loop

Visual horizon

Inertial horizon

Page 17: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Example 2 -- Immelmann maneuver

Extreme maneuver accomplished autonomously by controlling the position of the horizon in the I-Eye vision system

Thurrowgood, Soccol, Moore, Bland, Srinivasan (2011)

Visual horizon

Inertial horizon

Page 18: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Automatic landing

S. Thurrowgood, R.J.D. Moore, D. Soccol, D. Bland and M.V. Srinivasan (in progress)

Page 19: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

-4

-2

0

2

4

6

8

10

12

14

400 450 500 550 600 650 700 750 800

Accel XAccel YAccel Z

Height above ground

-6

-4

-2

0

2

4

6

8

10

12

200 300 400 500 600 700 800

Accel XAccel YAccel Z

Height above groundManual Manual

0

5

10

15

20

300 400 500 600 700 800

Accel XAccel YAccel Z

Height above ground

0

5

10

15

20

25

200 300 400 500 600

Accel XAccel YAccel Z

Height above groundAuto Auto

Automatic versus best manual landings: comparison

Page 20: Video Mirror camera - University of Queenslandrobotics.itee.uq.edu.au/~metr4202/2014/lectures/L8... · Camera 1 Mirror 1 Camera 2 Mirror 2 Surface of constant disparity Ground plane

Sam Baker, Daniel Bland, Natalie Bland, Nikolai Liebsch, Richard Moore, Gavin Taylor, Saul Thurrowgood, Dean Soccol