BLUE EYES TECHNOLOGY

Prepared By:- Prateek Gupta 07/CS/063

What is BLUE EYES Technology?

Aims at creating computational machines that have perceptual and sensory abilities like those of human beings.

Use camera and microphone to identify user actions and emotions.

Blue Eye stands for…..

What can we do with BLUE EYES Technology????? Ability to gather information about you and interact

with you through special techniques like facial recognition, speech recognition, etc.

Understand your emotions at the touch of the mouse.

Verify your identity, feel your presence, and start interacting with you.

The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.

System DesigningSystem Designing

Two major unitsTwo major units : :

- DAU (Data Acquisition Unit )DAU (Data Acquisition Unit )

- CSU (Central System Unit )CSU (Central System Unit )

System overviewSystem overviewCentral System UnitData Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Bluetooth

Bluetooth technology provides means for creating a Network linking the operators and the central system.

DataLogger

DAU - FeaturesDAU - Features

LightweightLightweight

Runs on batteries - Runs on batteries - low power low power consumptionconsumption

Easy to useEasy to use

ID cards for operator ID cards for operator authorizationauthorization

Data Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

Bluetooth

CSU – ComponentsCSU – Components

CONNECTION MANAGERCONNECTION MANAGER – main task to perform low-level – main task to perform low-level blue tooth communicationblue tooth communication

DATA ANALYSIS MODULEDATA ANALYSIS MODULE – performs the analysis of the – performs the analysis of the raw sensor data in order to obtain information about raw sensor data in order to obtain information about operator’s physiological conditionoperator’s physiological condition

DATA LOGGER MODULEDATA LOGGER MODULE – provides support for storing – provides support for storing the monitored data.the monitored data.

VISULAIZATION MODULEVISULAIZATION MODULE – provides user interface for – provides user interface for the supervisors the supervisors

CSU - FeaturesCSU - Features

Central System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth

Maintains Bluetooth Maintains Bluetooth connectionsconnections

Data processingData processing

Records conclusion for Records conclusion for further explorationfurther exploration

Provides visualization Provides visualization interfaceinterface

ConnectionManager

DataLogger

How can we make How can we make computers “see” and “feel” computers “see” and “feel” ??

Blue eyes uses sensing technology to Blue eyes uses sensing technology to identify a user’s actions and to extract key identify a user’s actions and to extract key information.information.

Information is then analyzed to determine Information is then analyzed to determine the user’s physical, emotional, or the user’s physical, emotional, or informational state.informational state.

Technologies Used

Emotion Mouse

Manual And Gaze Input Cascaded (MAGIC)

Simple User Interest Tracker (SUITOR)

Artificial Intelligent Speech Recognition

How deaf and dump

computer can

sense our

emotions????????

Emotional Computing Device

Emotion mouse sense the mood by analysing pressure , temperature and heart beat of the user.

Analysing these parameters six types of mood can be sensed by computer.

Emotion Mouse

THE DIFFERENT WAYS ARE-

How it works??????

Like humans have five sense organs, emotion mouse is designed with five sensors to sense the different moods of user.

Different moods of user

Happy

SadSurprise

Anger

Disgust

Webcam is used to quickly determine the glints and pupils of the user under variable and realistic lightning conditions.

MAGIC………

MAGIC pointing is the technique of tracking eye movement of the user and perform the desired operation.

Image of pupil of user’s eye is tracked using an infrared light source

SIMPLE USER INTEREST TRACKER (SUITOR) 

SUITOR

BLUE EYE enabled SUITORBLUE EYE enabled SUITOR becomes active becomes active when the user makes an eye contact and when the user makes an eye contact and automatically detect users area of interest automatically detect users area of interest and start searching it.and start searching it.

Help by fetching more information at desktop.

Notice where the user’s eyes focus on the screen.

For ex: If reading headline ,pops up the story in the browser window.

Artificial Intelligent Speech Recognition

Input words are scanned and matched against internally stored words.

Identification causes some action to be taken.

User speaks to the computer through microphone.

Pattern matching is designed to look for the best fit because of variations in loudness, pitch, frequency difference, time gap etc.

Applications of Speech Recognition

To control weapons by voice commands.

Pilot give commands to computers by speaking through microphones.

For making airline and hotel reservations.

For making reservations, canceling reservations or making enquiries.

Can be connected to word processors and instead of writing, simply dictate to them.

Blue Eyes Enabled DevicesPOD Technology used in cars

PONG A Robot

Emotional I pod

Smart Phone……

FUTURE APPLICATIONS

BLUE EYES technology can be used :

In automobile industry

In video games

To create “Face Responsive Display”.

For eg: A blue eyes enabled TV set would become

active when we look in its directions.Voice commands could then tune your favourite channel and adjust the volume.

CONCLUSION

In the future, ordinary household devices -- such as televisions, refrigerators, and ovens -- may be able to do their jobs when we look at them and speak to them.

Provide more delicate and user friendly facilities in computing devices.

The computers can be run using implicit commands instead of the explicit commands.

Thank You…

BLUE EYES TECHNOLOGY