Blue eye technology

( blue eyes –
Human operator
monitoring system )
 Agenda
•Motivation
•What is
BlueEyes ?
•Physiological
 Motivation
foundations  What is BlueEye technology ?
•System
design
 What is BlueEyes ?
•System 
implementation
System designing
•Future
 System overview
improvements
•Project work
 DAU
summary  CSU
•System
demonstration
 Data security
 IBM research
 Conclusion
 Motivation
•Motivation
•What is
BlueEyes ?
•Physiological  Human error - a frequent reason of
foundations
•System catastrophes and ecological disasters
design
•System
implementation
•Future -temporary indisposition
improvements
•Project work
-weariness
summary
•System
-oversight
demonstration
What is blue eye
technology ?
 The BLUE EYES technology
aims at creating
computational machines that
have perceptual and sensory
ability like those of human
beings.

 
How can we make
computers “see” and
“feel” ?
 Blue eyes uses sensing technology to
identify a user’s actions and to extract
key information.
 Information is then analyzed to
determine the user’s physical
,emotional ,or informational state.
 What is Blue Eyes ?
•Motivation
•What is
BlueEyes ?
•Physiological  The complex solution for human-
foundations
•System operator monitoring:
design
•System – Visual attention monitoring
implementation
•Future
– Physiological condition
improvements
•Project work
– Operator’s position detection
summary
•System
– Wireless data acquisition using bluetooth
demonstration
– Real time user defined alarm triggering
– Recorded data playback
What is BlueEyes not?
 Doesn’t predict nor interfere with
operator’s thoughts
 Cannot force directly the operator to
work
 App licat ions of Blue Eyes
•Motivation
•What is
BlueEyes ?
•Physiological  Generic control rooms
foundations
•System
design
(System can be applied in every working
•System environment
implementation
•Future requiring permanent operator’s attention)
improvements
•Project work
– Power station
summary
•System
– Captain bridge
demonstration
– Flight control centers
– Operating theatres – anesthesiologists
 BlueEy es - benefits
•Motivation
•What is
BlueEyes ?
•Physiological
foundations
•System
 Prevention from dangerous incidents
design
•System
implementation  Minimization of
•Future
improvements – ecological consequences
•Project work
summary – financial loss
•System
demonstration – a threat to a human life

 The reconstruction
of the course of
operator’s work
Implementation and
engineering
considerations
-THREE groups of users
 OPERATOR -a person whose physiological parameters are
supervised
- authorization in the system
- receiving alerts
 SUPERVISOR – a person responsible for analyzing operator’s

condition and performance.

 SYSTEM ADMINISTRATORS- maintains the system

deliver tools for adding

- new operator’s to the database
- defining alarm conditions
- configuring logging tools
- creating new analyzer modules
Designing
 A personal area network for
linking all the operators and the
supervising system
 Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
 System overview
•Motivation
•What is
BlueEyes ? Data Acquisition Unit Central System Unit
•Physiological
foundations
Atmel 89C52 Connection Visualization
•System Bluetooth Bluetooth Manager Module
design microcontroller
•Objectives
Jazz Data
•System Data Analysis
Multisensor Logger
overview
•DAU
•CSU

•System Bluetooth technology provides

implementation
•Future
means for creating a Personal
improvements
Area Network linking the
•Project work
summary operators and the central
•System
demonstration
system.
 The eye movement
•Motivation sensor
•What is
BlueEyes ?
•Physiological  Off-shelf eye movement sensor – Jazz
foundations
•System multisensor
design
•System
implementation
 Supplies raw digital data regarding
•Future
improvements
- Eye position
•Project work
summary
- Level of blood oxygenation
•System
demonstration - Acceleration along horizontal and
vertical axes
- Ambient light intensity
Jazz multisensor

Jazz Multisensor
Jazz
DAU
The DAU consists of the following components
 ATMEL 8952 microcontroller
 BLUE TOOTH MODULE – supports synchronous voice
data transmission
 PCM CODEC –used to transmit operator’s voice and
central system sound feedback
 UART –communication between bluetooth module and
microcontroller (115200 bps)
 MAX232 –level shifter
 ALPHAUNUMERIC LCD display
 LED indicators
 ID CARD interface
DAU - components

microphone MC 145483
earphone PCM codec

Jazz Multisensor Bluetooth

module
Beeper Atmel 89C52

UART
microcontroller
LCD display
UART MAX232
LED indicators
BlueEyes
Data Acquisition Unit
ID card Simple
interface keyboard
ID card
Microcontroller & blue
tooth module
EEPROMS & the PCB
 Implementation - DAU
•Motivation
•What is
BlueEyes ?
•Physiological

PCM codec board Microcontroller board

foundations
•System
design
•System
implementation

•DAU
•CSU
•Future
improvements Batteries and
•Project work
summary
voltageBluetooth module
level monitor
•System
demonstration
 DAU - features
•Motivation
•What is Data Acquisition Unit
BlueEyes ?
•Physiological
foundations
 Lightweight
Atmel 89C52 Bluetooth
•System
design microcontroller  Runs on batteries -
•Objectives
•System
Jazz low power
overview Multisensor
•DAU
consumption
•CSU  Easy to use - does not
•System
implementation disturb the operator
•Future
improvements
working
•Project work
summary
 ID cards for operator
•System
demonstration authorization
 Voice transmission
 CSU - features
•Motivation
•What is Central System Unit
BlueEyes ?  Connection
•Physiological
foundations management Connection Visualization
•System Bluetooth Manager Module
design
•Objectives
 Data
•System processing Data Analysis
Data
Logger
overview
•DAU  Visualization
•CSU
 Data recording
•System
implementation
 Access
•Future
improvements
verification
•Project work
summary
 System maintenance
•System
demonstration
CSU – components
 CONNECTION MANAGER – main task to
perform low-level blue tooth communication
 DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data in order to
obtain information about operator’s
physiological condition
 DATA LOGGER MODULE – provides support
for storing the monitored data.
 VISULAIZATION MODULE – provides user
interface for the supervisors
 CSU - Visualization
•Motivation Module
•What is
BlueEyes ?
•Physiological
 Raw and processed data visualization
foundations
•System
using:
design – VU-meters
•Objectives
•System – pie-charts
overview
•DAU – time series
•CSU

•System
implementation
•Future
 audio and video
improvements
•Project work data playback
summary
•System
demonstration
 Data security
•Motivation
•What is
BlueEyes ?
•Physiological  Only registered mobile devices
foundations
•System can connect to the system
design
•Objectives  Bluetooth connection authentication
•System
overview
•DAU
 Bluetooth connection encryption
•CSU  Access rights restrictions
•System
implementation  Personal and physiological data
•Future
improvements encryption
•Project work
summary
•System
demonstration
IBM research
 BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the
physiological attributes which are
correlated to emotions using
correlation model
-by simply touching the mouse ,the
computer will be able to determine a
person’s emotional state.
 BLUE EYE enabled TELEVISION – could
become active when the user makes
an eye contact.
Conclusion
 In the near future ,ordinary
household devices- such as
television , refrigerators ,ovens
may be able to do their jobs when
we look at them and speak to
them.
 Future applications of blue eye
technology is limitless
References

 www.seminar4u.com
 www.howstuffswork.com
 www.cs.put.poznan.com
 www.whitepapers.com
 www.ibmresearchcenter.com
 www.almaden.ibm.com
•Motivation
•What is

Thank you
BlueEyes ?
•Physiological
foundations
•System
design

BlueEyes
•System
implementation
•System
demonstration

Human-Operator
•Future
improvements
•Project work
summary

Monitoring System