Download - GESTURE TECHNOLOGY
GESTURE TECHNOLOGY
DESIGNED BYA.Hemanth
14A81A0563
A gesture is a form of non-verbal communication in which visible bodily actions communicate particular messages, either in place of speech or together and in parallel with words.
What Are GESTURES
Gestures are an important aspect of human interaction, both interpersonally and in the context of man-machine interfaces.
Gestures include movement of the hands, face, or other parts of the body.
Military air marshals use hand and body gestures to direct flight operations aboard aircraft carriers.
Types of GestureIconic
Iconic gestures represent object attributes, spatial relationships, and actions. For example, think about how you would describe
gesturally a tall person or a wide river as you were talking about each of those things.
Deictic, or Pointing These gestures are pretty basic, connecting speech to another idea, object of location. For instance, if you were talking about
someone across the room you might point them.
Metaphoric Metaphoric gestures put an abstract idea into a more literal, concrete form. Making your fingers into a v shape and raising
above indicates your victory or win
Beat Gestures Basically, these just keep the rhythm of speech, and they
convey no semantic content whatsoever
What is Gesture Recognition ?
Interface with computers using gestures of the human body, typically hand movements.
Gesture recognition is an important skill for robots that work closely with humans.
Gesture recognition is especially valuable in applications involving interaction human/robot for several reasons.
A smart T.V recognizing the hand movement to control the channels or to select a option from
the menu
A gesture recognition
software in a laptop that
recognizes the movement of
fingers used for performing various
tasks
Basic working of Gesture Technology
Types of Gesture RecognitionHand Gesture Recognition
Hand gesture recognition technology allows operations of complex machines using only a series of fingers and hand movements , eliminating the need of physical contact between operator and
machine
Facial Gesture Recognition
Facial Gesture Recognition creates an effective non-
contact interface between user and their machines
The goal of facial Gesture Recognition is to make
machine effectively understand human
emotions , regardless of the countless physical differences between
individuals
Even most cameras detects your smile to automatically
click a picture
Sign Language RecognitionCertain types of gesture recognition software can transcribe the symbols
represented through sign language into text
Effective sign language recognition can help the
deaf people to communicate with both other people as
well as the machine
Electrical Field Sensing Technology
Proximity of a human body or body part can be
measured by sensing electric fields .
These measurements can be used to measure the
distance of a human hand or other body part from
an object; this facilitates a vast range of applications
for a wide range of industries.
Types of Gesture Sensing Technology
Device Sensing Technology Device-based techniques use a
glove, stylus, or other position tracker, whose movements
send signals that the system uses to identify the gesture.
The glove is equipped with a variety of sensors to provide
information about hand position, orientation, and flex of fingers.
Vision Based TechnologiesThere are two approaches
to vision based gesture recognition:
Model based techniques:
They try to create a three dimensional
model of the users hand and use this for
recognition. Image based
methods:Image-based techniques
detect a gesture by capturing pictures of a user’s motions during
the course of a gesture.
Technology Behind ItWired gloves
These can provide input to the computer about the position and
rotation of the hands using magnetic or inertial tracking
devices. The first commercially available
hand-tracking glove-type device was the Data Glove , a glove-type device which could detect hand position, movement and finger
bending. This uses fiber optic cables running down the back of the hand. Light pulses
are created and when the fingers are bent, light leaks through small cracks and the loss is registered, giving an
approximation of the hand pose.
Thermal camerasAn infrared camera is a device that
detects infrared radiation(temperature) from the
target object and converts it into an electronic signal to generate a
thermal picture on a monitor or to make temperature calculations on it.
The temperature which is captured by an infrared camera can be measured or quantified
exactly, so that not only the thermal behavior can be observed but also the relative magnitude of temperature related problems can
be recognized and noted.
Controller –based gesturesThese controllers act as an extension of the body so that
when gestures are performed, some of their motion can be conveniently captured by software.
Single camera or a Proximity sensor
A normal camera or a proximity sensor can be used for gesture recognition where the resources/environment would not be
convenient for other forms of image-based recognition.
Uses Of Gesture RecognitionSocially assistive robotics
By using proper sensors worn on the body of a patient and by reading the
values from those sensors, robots can assist in patient rehabilitation. The
best example can be stroke rehabilitation.
Sign language recognitionJust as speech recognition can
transcribe speech to text, certain types of gesture recognition software
can transcribe the symbols represented through sign language
into text.
Virtual controllersFor systems where the act of finding
or acquiring a physical controller could require too much time, gestures can be used as an alternative control mechanism. Controlling secondary
devices in a car, or controlling a television set are examples of such
usage.
Remote control
Through the use of gesture recognition, remote control with the wave of a hand of various
devices is possible.
Aid to physically challenged
Machine wheel chairs are coming with gesture based system. The movement of
the hand will act as a controller of speed as well as
direction
Immersive gaming technologyIn video game consoles such
as Microsoft X-box with kinect sensors, often the user is the controller and has to perform all physical movements that they desire the character in
the game to do.