Department of Electronics & Communication Engineering

A Project Seminar On MOUSE CONTROL THROUGH IMAGE PROCESSING Submitted To :Ms. Monika Surana Ms. Anshu Toshniwal Submitted By :Vidit Virmani Priya Rawat Rajat Agnihotri

1

Image

processing is any form of signal processing for which the input is an image, such as a photograph or video frame; the output of image processing may be either an image or a set of characteristics or parameters related to the image.

In

this presentation we present a novel approach to HUMAN MACHINE INTERACTION, where we control cursor movement without any physical contact with computer hardware. method is to use a camera and computer vision technology, such as image segmentation and gesture recognition to control mouse tasks.

The

Interactive Human

human-machine interface.

machine interaction without using traditional input devices. at a distance

Communicate

Interact

in a 3-D world

The

project is composed of two components MATLAB for the interfacing of hand gesture

with the computer using image acquisition, image segmentation and image processing. C++/JAVA for the algorithms designed to

perform logical tasks by the mouse pointer.

CAMERA

:- We are using a web camera to capture the image. The resolution of the web camera is greater than the resolution of the desktop window. However, lower sensitivity and higher noise level are the two major drawbacks of web camera.

MOTION CAPTURE BY WEBCAM

IMAGE SEGMENTATION

MANIPULATION OF HAND MOVEMENTS BY ALGORITHM

CLICKS ON ICONS

POINTER MOVEMENT

Image capturing through webcam.Hand movement recognition.

Image manipulation through processing algorithms.Pointer movement on the screen. Clicks on icons as per the recognized gesture.

1) 2) 3) 4)

Center of mass Color detection by RGB method Grayscale method Gesture recognition

CURSOR

MOVEMENT

We are using the index

finger with yellow colour tape as a cursor controller to control mouse cursor movement.

LEFT

CLICK

the system records

the distance (say D) between the yellow and red tapes in the index finger and the thumb respectively.

LEFT

CLICK

When the distance between the tapes isd < D Then, the event is considered as Left click.

DOUBLE CLICK If distance between color tapes is

d < D For waiting time

t >= 7 secthen the event is recognized as double click event of the mouse cursor.

RIGHT

CLICK

If distance between color tapes is

D < d < D For waiting time

t >= 7 secpointing at the same location, then the event is recognised as the Right click event of the mouse cursor.

The system that we have proposed will completely revolutionize the way people would use the computer system.

It

eliminates the need for physical contact between operator and machine.

For deaf and dumb people to communicate with the world. For control of appliances in a home through gestures. For making interactive display boards to advertise products which can be operated with help of hand gestures. Can be used in mobile phones to perform gesture based events such as to stop the alarm

The

webcam must capture clear image.

Color

detection functions must be able to identify the specified colors. background of the user must not conflict with the colors used. should operate device in ample amount of light.

The

User

Hojoon

Park, A Method for Controlling Mouse Movement using a Real-Time Camera,2008. paper on Mouse Simulation Using Two Coloured Tapes by Kamran Niyazi, Vikram Kumar, Swapnil Mahe and Swapnil Vyawahare.

Research

www.gesturetek.com www.mathwork.com