are homes smart if they are aware?
DESCRIPTION
Invited talk by Marco Aiello at the 2nd Awareness Workshop on Challenges for Achieving Self-awareness in Autonomic Systems @ SASO 2012, Lyon, FranceTRANSCRIPT
![Page 1: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/1.jpg)
Marco Aiello
September 10, 2012
Are Homes Smart if they are Aware?
1
![Page 2: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/2.jpg)
Being aware of the presence
2
![Page 3: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/3.jpg)
Being aware of the presence
2
![Page 4: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/4.jpg)
Being aware of the presence
2
![Page 5: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/5.jpg)
✦ Sensor data provides basic context components
✦ Architectures taking advantage of awareness
✦ User expresses goals, explicitly or implicitly
3
![Page 6: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/6.jpg)
Some sensing today
4
![Page 7: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/7.jpg)
Some sensing today
... and is all getting networked
4
![Page 8: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/8.jpg)
Nest Thermostat
5
![Page 9: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/9.jpg)
✦ So we have the basic blocks for being aware, but...
✦ How do we become smart?
✦ How does the user take advantage of this?
6
![Page 10: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/10.jpg)
What is a smart home?
7
![Page 11: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/11.jpg)
What is a smart home?
A home is smart when, being aware of its own state
and that of its users, is capable of controlling itself in
order to support the users wishes, thus improving
their quality of life.
7
![Page 12: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/12.jpg)
What can it do?
8
![Page 13: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/13.jpg)
What can it do?
It understands (user) goals and it can satisfy them.
8
![Page 14: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/14.jpg)
9
![Page 15: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/15.jpg)
9
![Page 16: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/16.jpg)
10
![Page 17: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/17.jpg)
Is controlled by thoughts
10
![Page 18: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/18.jpg)
Reacts to dangersIs controlled by thoughts
10
![Page 19: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/19.jpg)
Reacts to dangers
It saves your life
Is controlled by thoughts
10
![Page 20: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/20.jpg)
Reacts to dangers
Reminds you of pillsIt saves your life
Is controlled by thoughts
10
![Page 21: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/21.jpg)
Goal
Domain descriptio
Composition
Orchestration
Context Awareness
Rule Engine
Repository
Plan
Context
User layer
Composition Layer
Pervasive layer
Discovery
11
![Page 22: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/22.jpg)
Context
›❯ Context reflects the state of the house, based on the information collected by the sensors
›❯ Represented as the values of all variables describing the house• E.g. temperature_in_kitchen=30 C, lamp1=ON,
location_of_user = in_bedroom
›❯ Keep up-to-date about the changing context through a publish-subscribe notification mechanism
12
![Page 23: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/23.jpg)
Composition
›❯ Domain-independent AI planning based on constraint satisfaction
›❯ A composition is generated on-the-fly, depending on the available services
13
![Page 24: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/24.jpg)
Composition
›❯ Input of the planner: • Domain description (from the repository): atomic
service operations seen as actions with pre-conditions and effects
• The current context (initial state)• A goal to be achieved, issued either by the user or
the house (rule engine)›❯ Output: • a sequence of actions-services that when executed
satisfy the goal
14
![Page 25: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/25.jpg)
Two actions
15
![Page 26: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/26.jpg)
Goal Language
›❯ Extended goal language to express complex requests
›❯ House domain and goal are encoded via constraints
›❯ The planning problem is translated to a constraint solving problem
›❯ Re-planning can be performed in case a service is out of order
16
![Page 27: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/27.jpg)
Goals
17
![Page 28: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/28.jpg)
Plans
18
![Page 29: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/29.jpg)
Implementation
›❯ 1.83 Ghz computer running Debian lenny, 32 bit and Java 1.6.0_12.
›❯ The constraint solver standing at the core of the planner is the Choco v2.1.1 constraint solving library
›❯ Model a home with 5 rooms, and 10 devices providing 21 UPnP action
19
![Page 30: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/30.jpg)
Evaluation
20
![Page 31: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/31.jpg)
Discussion++
›❯ Automatic, run-time, user-centric synthesis instead of hard-wired process descriptions [all we need is atomic descriptions, completely loosely-coupled]
›❯ Planner supports complex goals, variables with large domains (e.g. temperature)
›❯ Dynamic constraint network: efficient continual addition-removal of constraints according to context changes
21
![Page 32: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/32.jpg)
Discussion--
›❯ Efficiency: heuristics have to be improved for the system to scale
›❯ Incomplete pruning of irrelevant actions in some cases
›❯ React differently according to the kinds of faults
›❯ Concurrency issues (e.g. events interfering with execution)
22
![Page 33: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/33.jpg)
Making a home sm4all
23
![Page 34: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/34.jpg)
Goal
Domain descriptio
Composition
Orchestration
Context Awareness
Rule Engine
Repository
Plan
Context
User layer
Composition Layer
Pervasive layer
Discovery
24
![Page 35: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/35.jpg)
25
![Page 36: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/36.jpg)
26
![Page 37: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/37.jpg)
Evaluation at THFL (Leeuwarden)
Evaluation with Master Students (Groningen)
Physical test home at FSL (Rome)
Evaluation
27
![Page 38: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/38.jpg)
Evaluation at THFL (Leeuwarden)
Evaluation with Master Students (Groningen)
Physical test home at FSL (Rome)
23 Touch 8 BCI, average age > 71
30 Touch, average age > 25
with EU project officers
Evaluation
27
![Page 39: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/39.jpg)
28
28
![Page 40: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/40.jpg)
29
![Page 41: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/41.jpg)
30
![Page 42: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/42.jpg)
31
S M 4 L L
Sm4All project 1
t was in the spring of 2009 that via Tineke Hijma of the Tuiszorg Het FrieseLand I was asked wether I
would participate in a European project that can help people with limited mobility via domotics to be more independent at home. Initially, I thought that the SM4All (Smart Homes for All) project would be more in the medical area, but this later appeared to be not the case. SM4All is actually about how a computer-networked system in a home can satisfy specific user wishes that have some form of disability without the necessity for the person to physically act. If I would be living in such a smart home and someone would ring the doorbell, I could think `now open the door’ as an instruction and the computer system would capture such instruction and effectively open the door. The fact that I initially thought of a medical project was not un-logical since the interview that was performed in the following summer was mostly about my physical condition and its consequences. But the closing question was in the computer world, namely: ``what kind of automation would you like to have in your home if you could decide?’’ All the interviews have then been collected, analyzed and the conclusions discussed during a workshop in Madrid. For THFL was then also Tineke Hijma one of the participants.
First day
After the holidays I received a call from Johanna Rinsma, the Team-manager of Special Services at THFL, who wanted to follow up on the interview of 2009 and discuss the possibilities for me to take part in the second phase of the project. The time was such that what had been researched was now ready to be tested. The evaluation would take place at the premises of THFL in two sessions in different days. I was expected to go on November 18th, 2010.
From the reception area, I had a pretty dismal view of proud leftovers of the HTS (HogeTechnischeSchool, a secondary Dutch technical degree awarding institution) with its mighty steam engine where I had laid many footsteps in the past on my way to the Traffic Engineering lectures. A steam engine as the symbol of the first industrial revolution and so different from the computers chips that have brought so many changes in the second half of the last century in many technologies, including things of daily use such as cars and washing machines.
And after the internet hype around the turn of the millennium, we perceive the revelations of Wiki Leaks as the sign of the approach of a new era.The lounge of the night-care rooms of THFL was set up as a test area where many wires, monitors and laptops were ready for me and anticipated the entrance of a new virtual world. During the test trials the nurses Willy van der Brink and Dini Sieswerda were present to guide the participants, when necessary, to help with the translation of instructions from English to Dutch as the present
researchers were Italian and could only communicate in English with me.If one wants a TV to be turned on in the virtual home, for example, it is necessary that the computer ``knows’’ that one is thinking “now TV,’’ otherwise after a while nothing happens. Before the system can start, it must be first connected to my brain. This is done as in the hospital with an EEG that can register electroencephalographic modulations.
After an explanation of the test, I got the equipment on. I was sitting in front of a
display with a brown dot in the middle, an interface on my head taped over with a kind of bathing cap and with 16 electrodes that were linked to the system and a band around the chest just under the armpits. The test could begin. On the screen all letters and numbers appeared and at the top was the word 'water'. Water could be written by counting how often the letter W was in the first place while all letters and numbers were flashing on the screen quite rapidly: it was a question of good concentration to stay focused for
From Thoughts to ActionsHaje Haisma (1942-2011)
Translated by Marco Aiello, 2011
www.sm4all-project.eu February 2011
Haisma during the second day of evaluation with the brain computer interface on.
31
![Page 43: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/43.jpg)
32
![Page 44: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/44.jpg)
Electricity Awareness
33
![Page 45: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/45.jpg)
User Awareness
Ubiquitous System layer
Service Composition layer
Occupant behavior
Actuation & Building Context
Information
Energy-aware MiddlewareEvent-based, Service-Oriented, Orchestrating
User interaction, control, feedback
Ubiquitous SensingUser control
Component interactions
Actuation
Context User control
Activity
User Interface
www.greenerbuildings.eu
34
![Page 46: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/46.jpg)
Heat flow Awareness
35
![Page 47: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/47.jpg)
Greener Buildings
✦ Combine electricity, user and heat flow awareness
✦ Control to save energy
✦ Couple with Smart Grid Dynamic pricing to save money
36
![Page 48: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/48.jpg)
37
![Page 49: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/49.jpg)
38
![Page 50: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/50.jpg)
38
![Page 51: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/51.jpg)
Energy savings over a week (about 10%)
39
![Page 52: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/52.jpg)
Cost savings over a week (about 35%)
40
![Page 53: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/53.jpg)
A note on the Smart Grid
✦ The implication of having aware self controlling buildings and renewable energy sources will make also the Power Grid a self organizing system
41
![Page 54: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/54.jpg)
Network Evolutions
Forest fireKronecker model
Preferential AttachmentRandom Graph Random Graph Power Law
RMat Small World
Copying model
42
![Page 55: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/55.jpg)
Decision Support for Planning the Smart Grid
43
![Page 56: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/56.jpg)
Are homes smart if they are aware?
✦ Smartness requires awareness
✦ Need for integrated architectures
✦ Awareness alone won’t provide for smartness
44
![Page 57: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/57.jpg)
45
![Page 58: Are homes smart if they are aware?](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b3bd4f4a79599e528b46ed/html5/thumbnails/58.jpg)
Smartness is nothing without Awareness
45