robot control through gestures

22
SHANTILAL SHAH ENGINEERING COLLEGE Human Computer Interaction Based Hardware Control Using Image Processing Guided By : Prof. Devang G. Jani Prepared By : Amit H. Huda (110430111005) Sanjaysinh P.

Upload: amit-huda

Post on 09-Nov-2015

19 views

Category:

Documents


3 download

DESCRIPTION

Robot Control Through Gestures

TRANSCRIPT

SHANTILAL SHAH ENGINEERING COLLEGE

SHANTILAL SHAH ENGINEERING COLLEGEHuman Computer Interaction Based Hardware Control Using Image ProcessingGuided By :Prof. Devang G. JaniPrepared By :

Amit H. Huda (110430111005)Sanjaysinh P. Gohil(110430111006)Definition : Human Computer Interaction Based Hardware Control Using Image Processing.Why this Definition ?

New era of Digital World.

What is Our Purpose ?

Control System with Human Gestures.To make System more Intutive.

Why Gestures ?

What is Gestures ?

The motion of the body intended to communicate with other agents. How We use Gestures ?

We are using Markers.Detect Markers with Image Processing.Configure Detection With Command.

Requirements.SoftwareMatlabImage Processing tool.Arduino-1.0.3

HardwareAtmega32 Geared Motor's Web-Camera Relay'sAdapter/Battery (Power Supply)

Software Description:

What is MATLAB? MATLAB=Matrix Laboratory MATLAB is a high-level language and interactive environment that enables you to perform computationally intensive tasks faster than with traditional programming languages such as C,C++ and FORTRAN.MATLAB is an interactive, interpreted language that is designed for fast numerical matrix calculations. MATLAB is a high performance language for technical computing. It integrates computation, visualization, and programming in an easy-to use environment where problems and solutions are expressed in familiar mathematical notation.

MATLABAPPLICATIONS OF MATLABMath and computation.Algorithm development.Modeling, simulation.Data analysis, exploration ,and visualization.Scientific and engineering graphics.Application development, including Graphical User Interface building.

IMAGE PROCESSINGDefinition:- Image processing is study of any algorithm that takes an image as input and returns an image as output.

Image Processing Levels:-

Computer Vision: Object detection, recognition, shapeanalysis, tracking Use of Artificial Intelligence and

Image Analysis: Segmentation, Image registration, Matching.Image Processing: Noise removal, restoration , feature detection , compression.

Applications of Image Processing

BIOLOGICAL: :automated systems for an analysis of samples.DEFENSE/INTELLIGENCE: enhancement and interpretation of images to find and track targets.DOCUMENT PROCESSING: scanning, archiving, transmission.

MATERIALS TESTING: detection and quantification of cracks, impurities, etc.MEDICAL: disease detection and monitoring, therapy/surgery planning.

HARDWARE DESCRIPTIONThe Arduino Due milanove("2009" ) is a microcontroller board based on the ATmega328. It has 14 digital input/output pins (of which 6 can be used as PWM outputs), 6 analog inputs, a 16 MHz crystal oscillator, a USB connection, a power jack, an ICS header, and are set button. It contain severy thing needed to support the microcontroller; simply connect it to a computer with a USB cable or power it with a AC-to-DC adapter or battery to get started.

Arduino Due milanoveAtmega32: DC Motor's A DC Motor relies on the fact that like magnet poles repel and unlike magnetic poles attract each other.A coil of wire with current running through it generates an electromagnetic field aligned with the center of the coil.Motor having 4 elements in the circuit commonly known as corners: high side left, high side right, low side right ,and low side left .By using combination we are able to start, stop and reverse the current.

Fig. DC Motor

Fig1. Cross Sectional View of DC Motor

Web cameraHere we used 12 mega pixel web camera to detect the particular object.Relay'sA relay is an electrically operated switch. Current flowing through the coil of there creates a magnetic field which attracts a leverand changes the switch contacts. The coil current can be on or off so relays have two switch positions and they are double throw (changeover) switches

Fig:-Block Diagram of the System

Block Diagram

WorkingSystem starts and camera start to capturing photo or video.Program run on images and gets axis point (x,y) and height and width of object.Process Continue till condition for output not satisfied.As Condition for output Satisfied, Matlab gives the output Value to controller.controller gives input to the out put Device and it will work Continue. ProblemsComplexity of Programming Increase with Increase in gesture movements and Hand Markers.

Other object with the same properties as Hand Markers increase in Error.

Detecting Hand Markers in different situations like with less light, shadow , more than enough light

To Use System have to wear Hand markers all Time Possible SolutionOther Objects can handle by using Proper Threshold value for near as well as for far Objects.Threshold value

different situation can handle by High Resolution Camera or Compatible Environment and by using proper Threshold value Algorithm.

Wearing Markers can be solved by using different gesture or finger Combination. AdvantagesPortable.

Cost Effective.

Data access directly from the machines in real time. ApplicationsSwitching of Household appliancesIndustrial automated equipment carriersAutomated CarsSecurity Systems based on Face Recognition. Only the authorized user and administrator can access the application.In an Industrial Area where the worker cant handle the harmful equipments.To identify the unknown object. ReferenceMatlab(Image Processing)

Sixth Sense Device

www.mathworks.comThank You