january 20081 smart environments: artificial intelligence in the home and beyond diane j. cook...

January 2008 1

Smart Environments:Artificial Intelligence in the Home and Beyond

Diane J. Cookcook@eecs.wsu.edu

http://eecs.wsu.edu/~cook

BodyNets Topics

2

Smart Environments

Both generate largeamounts of data

Both need:

• data mining• prediction• classification / identification

What Is a Smart Environment?

An environment able to acquire and apply knowledge about the resident and the physical surroundings to improve the resident’s experience.

Imagine…

Face recognition, automated door entry

Smart sprinklers

Lighting control

Door/lock controllers,Surveillance system

Robot vacuum cleaner

Robot lawnmower

Intelligent appliancesClimate control

Automated blinds

Remote site monitoring and control

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

Our Initial Hypothesis

Resident interactions with smart environments can be automatedby analyzing and predicting resident behavior and using the informationto learn an automation model.

Smart Apartment

Smart Workplace

Technology

Perception

Sensornetwork

Off-the-shelfsensors

Action

PLC

Sensornetwork

ReasonData miningPrediction

Decision makerRule engine

Data Mining

Raw data

2005-01-03 09:47:30 i 5 1 100 mavpad2005-01-03 09:47:30 i 5 1 100 mavpad2005-01-03 09:56:17 i 5 0 0 mavpad2005-01-03 09:56:17 i 5 0 0 mavpad2005-01-03 13:04:45 a 1 1 100 mavpad2005-01-03 13:04:45 a 1 1 100 mavpad2005-01-03 13:05:37 i 3 1 2005-01-03 13:05:37 i 3 1 100 mavpad mavpad2005-01-03 13:06:11 c 4 1 100 mavpad2005-01-03 13:06:11 c 4 1 100 mavpad2005-01-03 13:06:22 c 4 0 0 mavpad2005-01-03 13:06:22 c 4 0 0 mavpad2005-01-03 13:16:33 S 19 1 100 mavpad2005-01-03 13:16:33 S 19 1 100 mavpad2005-01-03 13:16:33 S 70 1 100 mavpad2005-01-03 13:16:33 S 70 1 100 mavpad2005-01-03 13:16:34 i 5 1 100 mavpad2005-01-03 13:16:34 i 5 1 100 mavpad2005-01-03 13:16:44 i 3 0 0 mavpad2005-01-03 13:16:44 i 3 0 0 mavpad……

Patterns

% Turn on kitchen light when in room [PRODUCTION_PATTERN]ID = 560086344 V_19_1 V_19_0 i_1_1 x_0_0NumberOccurrences = 5V_19_1 V_19_0 V_19_1 V_19_0…x_0_0 1

% Kitchen Activities[ABSTRACT_PATTERN]ID = 549644 1487735365 1487712271 56008634 100100NumberOccurrences = 11487735365 1487712271 56008634 100100 1

101000101101000…101000101101000…

Prediction

•Parse sensor events using text compression

•Given recent history, predict next symbol (sensor event) with highest probability

a (5) b(4) d(2)c(1)

b(2)a (2)

c(1)a (1)

c(1)b(2)a (1)

a (1)

“aaababbbbbaabccddcbaaaa”

Decision Model

• Learn hierarchical model from data

• Learn automation rules with user and rule engine feedback

Results - Workplace

Results - Apartment

Prototype Smart Apartment

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

The Crisis of an Aging Population

The Crisis for Individuals

Financial Impact

10 / 2 / 15

• If we can keep 10% of population home 2 years longer, we will save Washington State $341 million/year

• $15 billion/year nationally

Mission

• Our vision is to keep older adults functioning independently in their own homes as long as possible.

• Our method integrates artificial intelligence, machine learning, and pervasive computing technologies into their everyday environments, turning them into smart environments.

What Assistance Is Needed?

NowNowNowNow PartialPartialPartialPartial FutureFutureFutureFuture

Activities of Daily Living (ADL) Technology

23

Sense

Identify

MotionMotion11

ENDEND

MotionMotion22

MotionMotion33

WateWaterrOnOn

MotionMotion44

WateWaterrOffOff

0.4

0.6

1.0

1.0 1.0

0.1 1.0

0.9

Model

P(“wash hands” | [Motion 1, Motion 3, Water On, Water Off]) = 0.54

P(“cooking” | [Motion 1, Motion 3, Water On, Water Off]) = ?

Remind

Remind• Medicine compliance

Assist

29

0

0.5

1

1.5

2

2.5

3

Voice / HandDisability

Assess

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

31

Load Profiling for Smart Home

Energy-Efficient Automation

Smart Communities

What’s Next?

35

To Learn More

36

http://eecs.wsu.edu/~cookcook@eecs.wsu.edu