blue eyes technology
TRANSCRIPT
Seminar onAN INTRODUCTION
TO BLUE EYES TECHNOLOGY
BYBY
CHANDRAKANT VASHISTHACHANDRAKANT VASHISTHA
ROLL NO. 0922631018ROLL NO. 0922631018
WHAT IS BLUE EYES WHAT IS BLUE EYES TECHNOLOGY?TECHNOLOGY?• Aims at creating computational machines Aims at creating computational machines
that have perceptual and sensory ability.that have perceptual and sensory ability.
• The basic idea behind this technology is to The basic idea behind this technology is to give the computer the human power.give the computer the human power.
• Due to this the machine can understand what Due to this the machine can understand what a user wants, where he is looking at and even a user wants, where he is looking at and even realize his physical or emotional states.realize his physical or emotional states.
• Use camera and microphone to identify user Use camera and microphone to identify user actions and emotions.actions and emotions.
Motivation for blue eyesMotivation for blue eyes
• Human error - a frequent reason of Human error - a frequent reason of catastrophes and ecological disasterscatastrophes and ecological disasters– weariness weariness – OversightOversight– Mental illnessMental illness• Monitoring of consciousMonitoring of conscious
brain involvement (automation in brain involvement (automation in
long driving)long driving)
The term BLUE EYESThe term BLUE EYES
• BLUE in the term stands for Bluetooth,BLUE in the term stands for Bluetooth,
which enables reliable wireless which enables reliable wireless communicationcommunication
• EYES , because the eye movement EYES , because the eye movement enables us to obtain a lot of enables us to obtain a lot of interesting and important informationinteresting and important information..
How can we make How can we make computers computers
“see”and“feel” ?“see”and“feel” ?Blue eyes uses sensing Blue eyes uses sensing
technology to identify a user’s technology to identify a user’s actions and to extract key actions and to extract key
information.information.
Information is then analyzed Information is then analyzed to determine the user’s to determine the user’s physical, emotional, or physical, emotional, or
informational stateinformational state..
What is blue eyes not?What is blue eyes not?
•Neither predicts nor interferes Neither predicts nor interferes with operator’s thoughtswith operator’s thoughts
•Cannot force directly the Cannot force directly the operator to workoperator to work
TECHNOLGIES USEDTECHNOLGIES USED
• Emotion MouseEmotion Mouse
• Manual And Gaze Input Cascaded Manual And Gaze Input Cascaded (MAGIC)(MAGIC)
• Artificial Intelligent Speech Artificial Intelligent Speech RecognitionRecognition
• Simple User Interest Tracker Simple User Interest Tracker (SUITOR)(SUITOR)
Touch recognitionTouch recognition
• Hardware: - mouseHardware: - mouse– Heart rateHeart rate– Temperature : thermocoupleTemperature : thermocouple– Galvanic skin response (gsr): digital Galvanic skin response (gsr): digital
multimetermultimeter– General somatic activity (gsa): General somatic activity (gsa):
movement of computer mousemovement of computer mouse• Emotions: Emotions:
Anger, fear, sadness, disgust, joy, Anger, fear, sadness, disgust, joy, surprisesurprise
Eye trackingEye tracking
• Hardware: - cmos camera, jazz Hardware: - cmos camera, jazz multisensormultisensor
– Eye movementEye movement– Eye position (gaze)Eye position (gaze)– Level of blood oxygenation accelerationLevel of blood oxygenation acceleration– Ambient light intensityAmbient light intensity
Speech recognition Speech recognition
• Scanned input words are matched Scanned input words are matched against internally stored known against internally stored known wordswords
• Slight variations: statistical Slight variations: statistical techniques for matching processtechniques for matching process
System overviewSystem overview Central System UnitData Acquisition Unit
Atmel 89C52microcontroller
JazzMultisensor
ConnectionManager
Data Analysis
VisualizationModuleBluetooth Bluetooth
Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.
DataLogger
applicationsapplications
• Generic control roomsGeneric control rooms– Power stationPower station– Flight control centersFlight control centers– Operating theatres Operating theatres
• Common applicationCommon application– A simpler system version for driversA simpler system version for drivers
Case study: professional Case study: professional driversdrivers
• Human factor in accidents : 92%Human factor in accidents : 92%
• Vehicle defects :Vehicle defects :
} 8%} 8%
• Road defects :Road defects :
Analogy between hci and Analogy between hci and dvidviHARDWARES
AND ESSENTIALS
Human
Computer
Interface
Driver Vehicle
Interface
Continuous attention
towards …… is required
Monitor screen Road, signal
conscious brain
involvement monitoring
Yes required Yes required
Oversight and weariness yes yes
For touch recognition Mouse, keyboard Steering, brake,
accelerator
Eye tracking towards Screen Signal, other vehicles
BLUE EYES ENABLED DEVICESBLUE EYES ENABLED DEVICES
PODPOD
Technology used in Technology used in carscars
PONGPONG
A RobotA Robot
Blue Eyes - benefitsBlue Eyes - benefits
•Prevention from dangerous Prevention from dangerous incidentsincidents
•Minimization ofMinimization of– ecological consequencesecological consequences– financial lossfinancial loss– a threat to a human lifea threat to a human life
FUTURE FUTURE DEVELOPMENTSDEVELOPMENTS
Security purposes.Security purposes.
ordinary household devices .ordinary household devices .
Eg : Working of television , Eg : Working of television ,
refrigerators & ovens when refrigerators & ovens when
we look at them.we look at them.
CONCLUSIONCONCLUSION
• Provide more delicate and user friendly Provide more delicate and user friendly facilities in computing devicesfacilities in computing devices
• Gap between the electronic and physical Gap between the electronic and physical world is reducedworld is reduced
• The computers can be run using implicit The computers can be run using implicit commands instead of the explicit commands instead of the explicit commandscommands
• Future applications of blue eye technology Future applications of blue eye technology is limitlessis limitless
Thank youThank you
Any Questions???Any Questions???