MICROCONTROLL-ER BASED

GESTURE VOCALIZER

COMMUNICATIONActivity of conveying

Information

Speech and Gestures

MICROCONTROLLER

SENSORIts a converter that measures a

physical quantity and converts it into a signal which can be read by an observer or by an instrument

A microprocessor with inbuilt memory and timers

Large Scale Multi-Microcontroller based system being designed to facilitate the communication among the deaf, dumb and blind.

GESTURE VOCALIZER

MODULES

1.DATA GLOVE

2.TILT DETECTOR

3.GESTURE DETECTOR

4.SPEECH SYNTHESIZER

5.LCD DISPLAY

BEND SENSOR

TILT SENSOR

DATA GLOVE

Data glove has five bend sensors one for each finger

Detects the static movements of finger

BEND SENSOR

BEND SENSOR

Made by using IC-555 timer(In astable mode) along with photo transistor

It has a square wave output

Frequency of this square wave varies with bending of bend sensor

BEND SENSOR

Accelerometer ADXL103, used as tilt detector which detects tilting of hand

Has an analog output varying from 1.5 volts to 3.5 volts

The output of accelerometer is provided to tilt detection module

TILT SENSOR

To decrease the sensitivity of the system , output of accelerometer is amplified using

additional circuitry

TILT SENSOR

TILT DETECTORChecks the output of accelerometer.

sends the binary data against some meaningful gesture to gesture detection module.

Gesture vocalizer system is a dual axis system which can detect tilt of hand in two axes.

Pipelined structure of two ADC 0804 ICs are used to digitize the outputs of two accelerometers.

TILT DETECTOR

Two ADCs have 8-bit output , common data bus and control lines

Pipelining of ADCs is done by using chip select pin

At a given time only one ADC is active

TILT DETECTOR

The microcontroller receives the data from two ADCs one by one and saves them

Now the microcontroller compares these values with predefined values in its memory to represent it’s a meaningful gesture or not

If it is a meaningful gesture, then microcontroller sends the data to gesture detection module

GESTURE DETECTORMost Important and core part

Microcontroller controlled circuitry

Three ports are in use(two input and one output)

• Port 0 • Port 1 • Port 2

GESTURE DETECTOR• Port 0 (Input port)

Microcontroller checks the output of first bend sensor , calculates its pulse width, stores this output and moves on

The bends are quantized into ten levels and the finger must be at any of these ten levels and the system knows how much each finger is bent.

Now the system reads the movements of all the fingers as a whole and moves on to next step , if the bend is a meaningful one.

GESTURE DETECTOR

• Port 1• Receives 8-bit data from tilt detector and if that is a

meaningful tilt, then the gesture as a whole (bend+tilt) is considered as a meaningful one and generates a 8-bit data

This 8-bit data can represent 256 (28 = 256) different gestures

Consists of a microcontroller, a speech synthesizer ( IC SP0256) and a speaker

The microcontroller receives the 8-bit data from gesture detector and determines what gesture has been made

The speech synthesizer IC SP0256 has some allophones

SPEECH SYNTHESIZER

Allophones-Sounds that are merely phonetic variants of the same phoneme are allophonesEg: ’s’ of sing and the ’r ’ of ring

Each allophone has a particular address location

The microcontroller’s 8-bit address corresponds to a particular allophone and same can be heard on speaker

SPEECH SYNTHESIZER

It is useful for the deaf

Voice is represented in text form

LCD

LCD

The 8-bit data given by gesture detection module is given to LCD module.

The LCD display module checks each word and compares it with previously stored values

Based on this comparison, the microcontroller decides what must be displayed on LCD

Two Accelerometers

OVERALL VIEW

Designing of wireless transceiver system for "Microcontroller and Sensors Based Gesture Vocalizer"

FUTURE ENHANCEMENTS

FUTURE ENHANCEMENTSPerfection in monitoring and sensing of

the dynamic movements involved in "Microcontroller and Sensors Based Gesture Vocalizer“

FUTURE ENHANCEMENTSThe Robot control system to regulate machine

activity at remote sensitive sites

Basis for communication for the disabled

Conveys sign language into voice for the blind and as text for the deaf

CONCLUSION

CONCLUSION

India’s population 121 million , 2.1% of population is disabled

Blind - 15 millionDeaf – 10 millionDumb – 2.7 million

Thus if proper light is thrown on R and D for this device , every person with the above three disabilities can communicate easily withanyone

THANK YOU