NAVEEN GUPTA 23060114th YEAR

COMPUTER SCIENCE

Gesture Recognition

Contents

1. Introduction2. History3. Concept4. Some hand gestures5. Input Devices6. Applications7. Some examples8. Challenges9. Future Scope10. Conclusion11. Thank You

Introduction

Interaction with computers are not comfortable experience Hand gesture recognition becomes important

Interactive human-machine interface and virtual environment Interpreting human  gestures  via mathematical  algorithms Richer bridge between machines and humans  Enables humans to interface with the machine and interact naturally

without any mechanical devices

History

Neural Networks 1945 - a process called Optical Character Recognition (OCR) June 1995 - Intel Workshop on  Automatic Face and Gesture Recognition 2001 - Intel expects the code and lead to the development of computer vision

applications such as face recognition, gesture recognition 2009 - Microsoft is already making your breakfast table-top

your computing screen. 

Concept

Based on Artificial Intelligence able to recreate the capabilities of the human  mind Intelligence  of machines and the branch of  computer

science  which aims to create it. Based on the idea that computers behave like humans Includes : game playing, robotics, neural networks etc.

Hand Gesture Recognition

Input Devices

The ability to track a person's movements and determine what gestures they may be performing can be achieved through various tools, some of which are:

Depth Aware CamerasStereo CamerasController-based gesturesSingle Camera

Depth Aware Cameras

A depth map of what is being seen through the camera at a short range is drawn

Used for 3D recognition

Effective for hand gestures

Stereo Cameras

Contains two or more lenses Stereo – photography Or a combo of two cameras whose relation to one-another are

known 1st lens – for focussing on the

object 2nd lens – to capture the image

Controller Based Gestures

act as an extension of the body when gestures are performed, some of their motion

can be conveniently captured by software. Example : Mouse gestures Wii Remote

Mouse gesture for “back” in Opera-user holds down the right mouse button, moves the mouse left, and releases the right mouse button.

Single Camera

Normal camera

where the resources would not be convenient

greater possibility of accessibility to a wider audience

not as effective as stereo or depth aware

cameras.

Applications:

Sign language recognition

- movement of hands, body, lip patterns and body language

For socially assistive robotsDirectional Indication through pointingControl through facial gesturesAlternative computer interfaces

Applications:

Immersive Game TechnologyVirtual ControllersAffective ComputingRemote Control

Can be used for weather presentations at any no. of stations

A space-age virtual game with attendees as “Starfleet” cadets was created by HoloPoint.

Interact with digital content such as advertising on a dynamic display with an array of over 70 special effects

This technology was also used in CNN Head-quarters.

Challenges

Limitations on equipment used

Image Noise

Background Noise

Resolution and quality

“Gorilla Arm”

Future Scope

Eye gesture recognition recognize winking, eyebrow raising, eyes being closed

deliberately, and deliberate eye movements left, right, up , down etc

But some limitations….

Recognition software showing it's best estimates of the pupil, eyebrow and eye locations.

Future Scope

The future of this technology is very bright and in this year,2009, Microsoft will launch its breakfast table top, which will be considered a huge achievement.

Progress will be made in recognizing gestures through the above mentioned eye gesture method and hopefully all its limitations would be overcome.

Hence, in the coming 4-6 years, this technology will attain great heights.

Conclusion

Way to interact with computers without any mechanical devices. Illiterate person can also operate a computer system More effective and friendly for human computer interaction  Vision-based interfaces for intelligent human computer interaction Based on the concept of artificial intelligence. Can be used for advertising New emerging technology Will bring about a big revolution in IT