201209 smart objects and semantic web

Smart Objects and Semantic Web: A semantic approach to intelligent environments

© 2012 Jun Hu

Department of Industrial Design PAGE 1 26-9-2012

26-9-2012

Semantic Web

• Access to universal knowledge


Semantic Web

• Siri


Semantic Web

• Ontology: Access to universal knowledge


Semantic Web

• Ontology: Categories of being


Semantic Web

• Ontology: in Resource Description Framework

− A collection of subject-predicate-object triples:

• A is B, B is C

• C has D

• …

• A loves B

• B hates A

• (S P O)


Semantic Web

• Ontology: in Resource Description Framework

− Artificial Intelligence

• A is B, B is C => A is C

• C has D => A has D

• …

• A loves B

• B hates A => A (can not marry) B

• (S P O)


Semantic Web

• Ontology on web => Semantic Web

• (S P O) => (#s #p #o)


Semantic Web


• (S P O) => (#s #p #o)


Semantic Web

• Siri


Semantic Web


• (S P O) => (#s #p #o)


Semantic Web



Semantic Web


− through

− Internet of Knowledge


Semantic Web


− through

− Internet of Knowledge

− by

− Internet of People


Social Networks

• Internet of People


Social Networks



A social network is a social structure made up of

individuals (or organizations) called "nodes", which

are tied (connected) by one or more specific types

of interdependency, such as friendship, kinship,

common interest, financial exchange, dislike,

sexual relationships, or relationships of beliefs,

knowledge or prestige.

http://en.wikipedia.org/wiki/Social_network

Social Networks



Social Networks


• Facebook

• Twitter

• LinkedIn

• Foursquare

• MySpace

• Weibo

• Renren

• …


Social Networks

• Internet of different People

• Facebook

• Twitter

• LinkedIn

• Foursquare

• MySpace

• Weibo

• Renren

• …


Social Networks


• Why?


Social Network


• Why?


Social Networks


• Why?

Department of Industrial Design PAGE 30 26-9-2012 Maslow's Hierarchy of _Needs

Social Networks


• Why?

Department of Industrial Design PAGE 31 26-9-2012 Maslow's Hierarchy of _Needs

Social Networks


• Internet of People Internet of Things


© http://www.economist.com/node/15350960

Social Network

• Network of People => Internet of People

• Internet of People Internet of Things



Internet of Things

What is it?



The Internet of Things refers to uniquely

identifiable objects (things) and their virtual

representations in an Internet-like structure.

© Wikipedia

Internet of Things

• Identifiable


Internet of Things

• Sensing


Internet of Things

• Actuating


Internet of Things

• Virtualization and connectivity


Internet of Things

• Local Intelligence

• Google I/O


• Web 3.0, the future of the internet

• http://youtu.be/FzIwXqqDnOY


http://youtu.be/FzIwXqqDnOY

• Interoperablibility in the interconnected world

• http://youtu.be/FzIwXqqDnOY




SOFIA

• Smart Objects for Intelligent Environments

• funded through the European Artemis programme


SOFIA

• Smart Objects for Intelligent Environments

• funded through the European Artemis programme

• Context:

• Smart Environment – ecosystem of interconnected and

interoperating smart objects

• Newly developed and legacy devices

• Connections and relations between smart objects

• Shifting from interacting with single products to interaction

with a system of products


Internet of Things and semantic Web


Service data gathering and mining

Ontology and semantics of the intents, interests and concepts

Internet of things Web of people

Sematic Information

Broker

Ontology

Blackboard

Knowledge

Processor Knowledge

Processor

Knowledge

Processor …

Smart

Object

Smart

Object

Smart

Object

…

Making "information" in the physical world available

for smart services - connecting the physical world

with the information world

SOFIA

• Demo: Semantic connections - Spotlight navigation

• http://youtu.be/bOrIPp-aglg


http://youtu.be/bOrIPp-aglg



SOFIA

• Pilot: Smart space

• http://youtu.be/NjSwTU9tX4w


http://youtu.be/NjSwTU9tX4w

SOFIA

• Based on Ontologies (Semantic Web)

• And the Blackboard Pattern


SOFIA

• Pilot scenario


SOFIA

• Ontology: RDF


SOFIA

• Ontology: OWL


SOFIA

• Ontology: devices


SOFIA

• Ontology: interaction events


SOFIA

• SIB


SOFIA

• SIB Ontology

• Create/Add/Remove/Update


SOFIA

• SIB Ontology


• Query (SPARQL)


SOFIA

• SIB Ontology


• Query (SPARQL)

• Reasoning (SPIN – SPARQL Inferencing Notation)


SOFIA

• KP


SOFIA

• Based on Ontologies (Semantic Web)

• And the Blackboard Pattern


Student projects


Doormate

Bonsai Garden

Bonsai Garden

• Gaming elements

Bonsai Garden

Resources

• https://github.com/iddi/sofia

• What you would need: • Eclipse for RCP and RAP Developers (Helios)

• EGit

• Android ADK (if Android is used)

• SOFIA ADK

• TUeSIB

• Python (if python is preferred)

• Smart-M3 Python KPI

• SSLS

• …

• More at: https://github.com/iddi/sofia/wiki/Installation


https://github.com/iddi/sofia

https://github.com/iddi/sofia/wiki/Installation

Resources

• SOFIA is based on SMART-M3

• M3: multi-vendor, multi-device and multi-part • About SMART-M3:

• http://en.wikipedia.org/wiki/Smart-M3

• SMART-M3 on source forge:

• http://sourceforge.net/projects/smart-m3/


http://en.wikipedia.org/wiki/Smart-M3



http://sourceforge.net/projects/smart-m3/



Resources

• SOFIA is contunued:

• https://sofia-community.com/


https://sofia-community.com/



References


1. G. Niezen, ONTOLOGIES FOR INTERACTION: Enabling serendipitous interoperability in smart environments. PhD Thesis, Eindhoven University of Technology, 2012.

2. B. J. J. van der Vlist, Designing Semantic Connections Explorations, Theory and a Framework for Design. PhD Thesis, Eindhoven University of Technology, 2012.

3. B. J. J. van der Vlist, G. Niezen, S. Rapp, J. Hu, and L. M. G. Feijs, "Controlling Smart Home Environments with Semantic Connections: a Tangible and an AR Approach," presented at the 7th International

Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand, 2012.

4. B. J. J. van der Vlist, J. Hu, G. Niezen, and L. M. G. Feijs, "Semantic Connections: a New Interaction Paradigm for Smart Environments," presented at the 7th International Workshop on the Design & Semantics

of Form & Movement (DeSForM), Wellington, New Zealand, 2012.

5. J. P. A. Peeters, B. J. J. van der Vlist, G. Niezen, J. Hu, and L. M. G. Feijs, "A Study on a Tangible Interaction Approach to Managing Wireless Connections in a Smart Home Environment," presented at the 7th

International Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand., 2012.

6. J. Hu, B. van der Vlist, G. Niezen, W. Willemsen, D. Willems, and L. Feijs, "Designing the Internet of Things for Learning Environmentally Responsible Behaviour," Interactive Learning Environments, vol.

Accepted., 2012.

7. W. Willemsen, J. Hu, G. Niezen, and B. van der vlist, "Using Game Elements to Motivate Environmentally Responsible Behaviour," presented at the IADIS Game and Entertainment Technologies 2011 (GET

2011), Rome, Italy, 2011.

8. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Interaction primitives: Describing interaction capabilities of Smart Objects in ubiquitous computing environments," presented at the AFRICON, 2011, Livingstone

2011.

9. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Desiqn semantics of connections in a smart home environment," Creation and Design, vol. 13, pp. 18-24, 2011.

10. G. Niezen, B. van der vlist, J. Hu, and L. M. G. Feijs, "Using semantic transformers to enable interoperability between media devices in a ubiquitous computing environment," presented at the International

Workshop on Self-managing Solutions for Smart Environments (S3E 2011) at the 6th International Conference on Grid and Pervasive Computing (GPC 2011), 2011.

11. M. Kwak, G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "Tangible Interfaces to Digital Connections, Centralized versus Decentralized," Transactions on Edutainment, vol. V, LNCS 6530, pp. 132-146, 2011.

12. J. Hu, B. van der vlist, G. Niezen, W. Willemsen, D. Willems, and L. M. G. Feijs, "Learning from Internet of Things for Improving Environmentally Responsible Behavior," in Edutainment Technologies.

Educational Games and Virtual Reality/Augmented Reality Applications, M. Chang, W.-Y. Hwang, M.-P. Chen, and W. Müller, Eds., ed: Springer Berlin / Heidelberg, 2011, pp. 292-299.

13. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Design Semantics of Connections in a Smart Home Environment," presented at the Design and Semantics of Form and Movement (DeSForM 2010), Lucerne,

Switzerland., 2010.

14. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Semantic Connections: Exploring and Manipulating Connections in Smart Spaces," presented at the 2010 IEEE Symposium on Computers and Communications

(ISCC), Riccione, Italy, 2010.

15. G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "From Events to Goals: Supporting Semantic Interaction in Smart Environments," presented at the 2010 IEEE Symposium on Computers and Communications

(ISCC), Riccione, Italy, 2010.

201209 smart objects and semantic web

Technology

van der vlist

intelligent

smart home

semantic web

social networks

semantic web

semantic web

sofia smart