tno nieuwe huisstijlpublications.tno.nl/publication/100709/brbazw/tno-2012-m10391.pdf · content...
TRANSCRIPT
![Page 1: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/1.jpg)
Memorandum
Behavioural and Societal
Sciences
Kampweg 5
3769 DE Soesterberg
Postbus 23
3769 ZG Soesterberg
www.tno.nl
T +31 88 866 15 00
F +31 34 635 39 77
Datum
31 juli 2012
Onze referentie
M10391
Doorkiesnummer
+31 88 866 59 82
Van
Dr. J.B.F. van Erp
Onderwerp
ePartner architecture workshops 'The Results'
Zie bijlage
![Page 2: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/2.jpg)
dinsdag 31 juli 2012
ePartner architecture workshop
The results
Egon, John, Kim, Leo, Olivier, Mark, Bert, Friso, Zoltan, Paul, Jurriaan, Joris, Remco, Wessel
![Page 3: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/3.jpg)
Content
This presentation is the deliverable of the ePartner architecture
workshop held on April 23 – 24, 2012 in Zeist as part of
ETP Gedrag & Innovatie.
What is an ePartner?
What are the requirements for an ePartner?
How does the architecture for an ePartner framework look like?
Conclusions
Future work/Open research questions
Roadmap
![Page 4: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/4.jpg)
What does a ePartner do?
Support a human during life to realize human needs (Maslow*)
Physiological needs (e.g., nutrition)
Safety needs (e.g., personal and
financial security, health and well-being)
Belonging (e.g., social support)
Esteem (e.g., acknowledgement)
Self-actualization (e.g., learning)
* Maslow, A.H. (1943). "A Theory of Human Motivation," Psychological Review 50(4): 370-96.
![Page 5: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/5.jpg)
Illustrations of ePartners
![Page 6: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/6.jpg)
How does a ePartner do it?
An ePartner …
… collects data about the user and context (physical, social, temporal)
… reasons, based on what all ePartners (and what their users?)
collectively know
… responds in a human-like manner (intuitive, empathetic, affective,
own character) to what it knows
… socializes, i.e., involve social environment and ePartners
… learns from human-ePartner interaction (e.g., behavior, feedback)
![Page 7: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/7.jpg)
What are ePartner requirements?
An ePartner should …
… keep information private and safe
… be trustworthy for the user
… use its information in an ethical way
… be transparent in its behavior
![Page 8: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/8.jpg)
Task: construct an ePartner architecture
Group task
Construct a common, coherent and consistant architecture for
ePartners to be developed in.
Proposed solution
Service oriented architecture based on intelligent sensor networks
Tailored towards specific human-ePartner needs
![Page 9: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/9.jpg)
WORLD
Architecture: the big dataflow picture
SUBWORLD
MODEL
SUBWORLD
S A
DAQ
&
PROC
APP
Knowledge base
“Isolation” of apps from sensing
ARCHITECTURE
![Page 10: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/10.jpg)
Architecture: dataflow details
SUBWORLD
MODEL
S A
DAQ
&
PROC
APP
primary (“raw”)
derived
(“processed”)
proc.
component proc.
component processing
component
“trusted” app as
processing
component
Implicit is the
dataflow graph!
![Page 11: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/11.jpg)
Architecture: dataflow details
connection
(e.g. internet)
proxy
processing
functionality
proxy
processing
functionality
access control
discovery
payment
…
![Page 12: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/12.jpg)
Control flow
WORLD
SUBWORLD
MODEL
SUBWORLD
S A
DAQ
&
PROC
APP
PLANNER
tokens world state
dataflow graph
Time scheduling
is in the planner
and NOT in DAQ
& APP
general planning knowledge
heuristics etc.
![Page 13: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/13.jpg)
Planner
PLANNER
tokens world state
dataflow graph general planning knowledge
heuristics etc.
Planner receives tokens (requests for information: calculation or
acquisition from sensor &/or user)
It determines if, when and in which order to release propagated
tokens
It considers metadescriptors (Quality, Timewindow, etc) in this
process.
![Page 14: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/14.jpg)
Flow of control
Keeping world model up to date always might not be useful all the
time (wasting computation and communication resources)
Processing graph defines the dependencies between output,
transformations and input
Request propagation needs non-trivial processing (because of
specific ePartner requirements) [The planner]
![Page 15: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/15.jpg)
Let’s add an app!
APP
An app always has a descriptor
Simple case: all requirement for the app
are already available on the device ->
deploy and have fun.
Complex case: matching process takes
into account: local capabilities and
available components in repository and
makes a decision which components
should be deployed
Matching can be simple or complex
optimization process
Management (matching) can be done
locally (not optimized) and centralized
DESCRIPTOR Input?
Computational demand?
Storage demand?
Permissions/Payment?
Repository - Apps with descriptor
- Processing functionalities
- Data acquisition
- World model components
![Page 16: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/16.jpg)
Example: exercise/workout app
Basic idea: calculate the energy burned and giving feedback on
quality of exercise.
SUBWORLD
MODEL
S A
DAQ
&
PROC
APP
primary (“raw”)
derived
(“processed”)
proc.
component proc.
component processing
component
EW
App
S
• GPS
• Accelero
• User
• GPS
• Acc
• Motion state
estimation
• Mood
estimator
User (with attributes) • Mood
• Position
• Speed
Each containing (Value, Unit,
Certainty, Time stamp and
Time window)
A
![Page 17: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/17.jpg)
Example: exercise/workout app data flow
Mood
estimator
APP
Quality of
exercise
APP
Energy burned
Position
estimator
Speed
estimator
S user
S gps
S acc
Quality/scoring
Calories
A screen
A screen
T
T
T
T
T
Token indicating the primary
request for calorie information Propagated
tokens Both tokens are merged
![Page 18: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/18.jpg)
Architecture: Physical view
ePartner architecture runs primarily local, but can be
synchronized with your own home server (for backup
and history, family etc)
ePartner server for repository and directory services
(look up other ePartners) (Explicitly NOT sharing
subworld models here)
ePartners can communicate over
networks (Wifi/3G to internet,
Bluetooth to local devices)
![Page 19: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/19.jpg)
Conclusions
Different markets need specific ePartners
A generic framework helps TNO to create ePartners in a more
efficient en faster way
A service oriented architecture could be tailored to fit the ePartner
architecture needs
The ePartner expert group has a common understanding of the
ePartner architecture
This outcome forms a solid base for
future broad use within TNO
![Page 20: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/20.jpg)
Future work/ Open research questions
Privacy
Hoe afhankelijk is de privacy van
gebruikers voor verschillende
toepassingen.
Wat gebeurt er met privacy
gevoelige gegevens binnen de
ePartner? Wie is eigenaar?
Ethics
Welke verantwoordelijkheden heeft
een ePartner in ethische kwesties?
tov van de gebruiker
tov de maaatschappij
“met drank op achter het
stuur”, “door rood lopen”,
advies rondom
zwangerschap”
Einde van het spectrum:
“Waar kan ik hier een bom
kopen?”
Trust
Hoe perfect moet je ePartner zijn?
Hoe dwingend is de suggestie van een ePartner?
In hoeverre vertrouwt de ePartner de informatie over
jou?
Autonomy
“Zal ik dit voortaan automatisch voor je doen?”
Transparent
why does ePartner behave the way it does and for
whom?
![Page 21: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/21.jpg)
Proposed steps towards implementation
First start with a mobile device and a server (for example use
Android)
Extend the functionality
Extend the number of devices
Who to ask for implementation Service Oriented Architecture SOAP?
Mobile computing group TNO mobility
DSS/imaging The Hague
![Page 22: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/22.jpg)
Roadmap
2012 2017 2022 Current assistants
are fragmented and
standalone
Future ePartners
are integrated, connected
and personal
from Assistants to ePartners
Stand alone device
Fragmented apps
Single tasks
Reason over large datasets
Connected
Integrated in daily life
Ambient &
non intrusive
Personal
Persuasive
Sub conscious
![Page 23: TNO Nieuwe huisstijlpublications.tno.nl/publication/100709/brBAzW/TNO-2012-M10391.pdf · Content This presentation is the deliverable of the ePartner architecture workshop held on](https://reader036.vdocuments.us/reader036/viewer/2022070615/5c750e3409d3f231488b603b/html5/thumbnails/23.jpg)