Virtual Pointing Device Using Stereo Camera

The 6th International Conference on Applicationsand Principles of Information Science

Jan. 20-23, 2007, Kuala Lumpur, Malaysia

Graduate school of Design & IT, Dongseo University Nam-Seok Choi, Seung-Jae Lee, Byung-Gook Lee

Seung-Jae Lee, frog3147@dit.dongseo.ac.kr

AGENDA

What is Pointing Device? Virtual Point System System Architecture Detection and Recognition Coordinate Mapping Mouse Interaction Future works

What is Pointing Device?

Message

Virtual Point System

Ubiquitous concept

Using USB Camera

Escape from the limit of location by Image Processing

System Architecture

Hardware part 2 USB Camera Capture frame Beam Projector

Software part Image Processing Module Coordinate mapping Module Mouse Interaction Module

Image Processing

30 frame per sec

Fix camera at 45 degree angle

Needed Frame that limit user motion

Image Processing

Save the first frame image

Get real time image data

Set change gray scale

image

Compare first image and real

time image

Get Difference of image

Get Hand’s position

Detection and Recognition

User movement capture module

Detection and Recognition

Motion detection

Coordinate Mapping

L R

Coordinate Mapping

P(x, y) ! Q(u;v)

Coordinate Mapping

180/arctan xy

L

180/)(

arctan

xWidth

yR

( )Lv y u x ( )Rv y u x

{ 0} {(1 ) 1024}u u { 0} {(1 ) 768}v v

(1)

(2)

(3)(4)

(5)(6)

Detection and Recognition

A method of point detection

Mouse Interaction

Mouse move event

Mouse Left button click event

Future works

Improve the system to more approach the Ubiquitous system.

Free camera angle

Remove the Capture frame

Thank you!!Have a good time in Malaysia.