data science for pervasive intelligence · ambient intelligence “an environment that is sensitive...
TRANSCRIPT
Data Science for Pervasive Intelligence
an AI flagship project for SDSI
May 23rd, 2014
Stanford UniversityComputer Science Department
Silvio Savarese
Ambient intelligence
“An environment that is sensitive to the presence of people and is capable to respond
to and predict people needs”
Zelkha & Epstein 1998; Aarts, Harwig & Schuurmans 2001):
Smart house, office or car
The intelligent home
Pervasive intelligence paradigm
• Sense the world
• Associate sensory data to semantics
• Understand human instructions
• Communicate back and act appropriately
Smart hospital rooms
Smart disaster management
Image: SERS
Key ingredients
• Personalized• Adaptive• Anticipatory• Communicative• Context aware
Context awareness
Key ingredients
• Personalized• Adaptive• Anticipatory• Communicative• Context aware• Knowledge aware
Knowledge awareness
Knowledge awareness
What could a data center do?
Don’t just need to stuck up data
but also make intelligent use of it!
What could a data center do?
Data Science for Pervasive Intelligence
Data
…
Data Science for Pervasive Intelligence
Data Semantics
…
Data Science for Pervasive Intelligence
Data
Context
Semantics
…
Data Science for Pervasive Intelligence
Data
Context
Semantics
…
Knowledge
Commu-nication
Data
Context
Data Science for Pervasive Intelligence
Semantics
…
Knowledge
Data Science for Pervasive Intelligence
Commu-nication
Data
Context
Semantics
…
Knowledge
Manning, Li, Liang, Ng, Bernstein, Re’, HanrahanSavarese, Guibas, Khatib, Thrun, Salisbury
Visual Genome ProjectFei-Fei Li
Michael Bernstein
Chris Re
Networks For Information Transport Between Data
Leo Guibas
Objects:PLATE, FORK
ON(FORK, TABLE)ON(PLATE, TABLE)ON(CAKE, PLATE)
“There is a piece of cake on a table.”
Scene Generation
3D ModelsSpatial Knowledge Base
Objects:CAKE, TABLE
ON(CAKE, TABLE)
Semantic Parsing
INTERACTION
Scene Inference
ObjectSelection
right
Text-to-3D Scene Generation
Manning, Liang, Ng, Hanrahan
24
Baby visionSavarese
Data Science for Pervasive Intelligence
Commu-nication
Data
Context
Semantics
…
Knowledge
Thank you!