Smart Objects and Semantic Web: A semantic approach to intelligent environments

© 2012 Jun Hu

Department of Industrial Design PAGE 208-04-23

PAGE 308-04-23

PAGE 408-04-23

PAGE 508-04-23

PAGE 608-04-23

PAGE 708-04-23

Semantic Web

• Access to universal knowledge

Department of Industrial Design PAGE 808-04-23

Semantic Web

• Siri

Department of Industrial Design PAGE 908-04-23

Semantic Web

• Siri

Department of Industrial Design PAGE 1008-04-23

Semantic Web

• Siri

Department of Industrial Design PAGE 1108-04-23

Semantic Web

• Ontology: Access to universal knowledge

Department of Industrial Design PAGE 1208-04-23

Semantic Web

• Ontology: Categories of being

Department of Industrial Design PAGE 1308-04-23

Semantic Web

• Ontology: in Resource Description Framework− A collection of subject-predicate-object triples:

• A is B, B is C• C has D• …• A loves B• B hates A

• (S P O)

Department of Industrial Design PAGE 1408-04-23

Semantic Web

• Ontology: in Resource Description Framework− Artificial Intelligence

• A is B, B is C => A is C• C has D => A has D• …• A loves B• B hates A => A (can not marry) B

• (S P O)

Department of Industrial Design PAGE 1508-04-23

Semantic Web

• Ontology on web => Semantic Web• (S P O) => (#s #p #o)

Department of Industrial Design PAGE 1608-04-23

Semantic Web

• Ontology on web => Semantic Web• (S P O) => (#s #p #o)

Department of Industrial Design PAGE 1708-04-23

Semantic Web

• Ontology on web => Semantic Web• (S P O) => (#s #p #o)

Department of Industrial Design PAGE 1808-04-23

Semantic Web

• Siri

Department of Industrial Design PAGE 1908-04-23

Semantic Web

• Ontology on web => Semantic Web• (S P O) => (#s #p #o)

Department of Industrial Design PAGE 2008-04-23

Semantic Web

• Access to universal knowledge

Department of Industrial Design PAGE 2108-04-23

Semantic Web

• Access to universal knowledge− through − Internet of Knowledge

Department of Industrial Design PAGE 2208-04-23

Semantic Web

• Access to universal knowledge− through − Internet of Knowledge

− by− Internet of People

Department of Industrial Design PAGE 2308-04-23

Social Networks

• Internet of People

Department of Industrial Design PAGE 2408-04-23

Social Networks

• Internet of People

Department of Industrial Design PAGE 2508-04-23

A social network is a social structure made up of individuals (or organizations) called "nodes", which are tied (connected) by one or more specific types of interdependency, such as friendship, kinship, common interest, financial exchange, dislike, sexual relationships, or relationships of beliefs, knowledge or prestige.

http://en.wikipedia.org/wiki/Social_network

Social Networks

• Internet of People

Department of Industrial Design PAGE 2608-04-23

Social Networks

• Internet of People• Facebook• Twitter• LinkedIn• Foursquare• MySpace

• Weibo• Renren

• …

Department of Industrial Design PAGE 2708-04-23

Social Networks

• Internet of different People• Facebook• Twitter• LinkedIn• Foursquare• MySpace

• Weibo• Renren

• …

Department of Industrial Design PAGE 2808-04-23

Social Networks

• Internet of People• Why?

Department of Industrial Design PAGE 2908-04-23

Social Network

• Internet of People• Why?

Department of Industrial Design PAGE 3008-04-23

Social Networks

• Internet of People• Why?

Department of Industrial Design PAGE 3108-04-23Maslow's Hierarchy of _Needs

Social Networks

• Internet of People• Why?

Department of Industrial Design PAGE 3208-04-23Maslow's Hierarchy of _Needs

Social Networks

• Internet of People• Internet of People Internet of Things

Department of Industrial Design PAGE 3308-04-23

© http://www.economist.com/node/15350960

Social Network

• Network of People => Internet of People• Internet of People Internet of Things

Department of Industrial Design PAGE 3408-04-23

© http://www.economist.com/node/15350960

Internet of Things

What is it?

Department of Industrial Design PAGE 3508-04-23

© http://www.economist.com/node/15350960

The Internet of Things refers to uniquely identifiable objects (things) and their virtual representations in an Internet-like structure.

© Wikipedia

Internet of Things

• Identifiable

Department of Industrial Design PAGE 3608-04-23

Internet of Things

• Sensing

Department of Industrial Design PAGE 3708-04-23

Internet of Things

• Actuating

Department of Industrial Design PAGE 3808-04-23

Internet of Things

• Virtualization and connectivity

Department of Industrial Design PAGE 3908-04-23

Internet of Things

• Local Intelligence• Google I/O

Department of Industrial Design PAGE 4008-04-23

• Web 3.0, the future of the internet• http://youtu.be/FzIwXqqDnOY

Department of Industrial Design PAGE 4108-04-23

• Interoperablibility in the interconnected world• http://youtu.be/FzIwXqqDnOY

Department of Industrial Design PAGE 4208-04-23

SOFIA

• Smart Objects for Intelligent Environments• funded through the European Artemis programme

Department of Industrial Design PAGE 4308-04-23

SOFIA

• Smart Objects for Intelligent Environments• funded through the European Artemis programme

• Context:• Smart Environment – ecosystem of interconnected and

interoperating smart objects• Newly developed and legacy devices• Connections and relations between smart objects• Shifting from interacting with single products to interaction

with a system of products

Department of Industrial Design PAGE 4408-04-23

Internet of Things and semantic Web

Department of Industrial Design PAGE 4508-04-23

Service data gathering and mining

Ontology and semantics of the intents, interests and concepts

Internet of things Web of people

Sematic Information Broker

Ontology

Blackboard

Knowledge Processor

Knowledge Processor

Knowledge Processor…

Smart Object

Smart Object

Smart Object

…

Making "information" in the physical world available for smart services - connecting the physical world with the information world

SOFIA

• Demo: Semantic connections - Spotlight navigation• http://youtu.be/bOrIPp-aglg

Department of Industrial Design PAGE 4608-04-23

SOFIA

• Pilot: Smart space• http://youtu.be/NjSwTU9tX4w

Department of Industrial Design PAGE 4708-04-23

SOFIA

• Based on Ontologies (Semantic Web)• And the Blackboard Pattern

Department of Industrial Design PAGE 4808-04-23

SOFIA

• Pilot scenario

Department of Industrial Design PAGE 4908-04-23

SOFIA

• Ontology: RDF

Department of Industrial Design PAGE 5008-04-23

SOFIA

• Ontology: OWL

Department of Industrial Design PAGE 5108-04-23

SOFIA

• Ontology: devices

Department of Industrial Design PAGE 5208-04-23

SOFIA

• Ontology: interaction events

Department of Industrial Design PAGE 5308-04-23

SOFIA

• SIB

Department of Industrial Design PAGE 5408-04-23

SOFIA

• SIB Ontology• Create/Add/Remove/Update

Department of Industrial Design PAGE 5508-04-23

SOFIA

• SIB Ontology• Create/Add/Remove/Update• Query (SPARQL)

Department of Industrial Design PAGE 5608-04-23

SOFIA

• SIB Ontology• Create/Add/Remove/Update• Query (SPARQL)• Reasoning (SPIN – SPARQL Inferencing Notation)

Department of Industrial Design PAGE 5708-04-23

SOFIA

• KP

Department of Industrial Design PAGE 5808-04-23

SOFIA

• Based on Ontologies (Semantic Web)• And the Blackboard Pattern

Department of Industrial Design PAGE 5908-04-23

Student projects

Department of Industrial Design PAGE 6008-04-23

Doormate

Doormate

Doormate

Doormate

Bonsai Garden

Bonsai Garden

• Gaming elements

Bonsai Garden

Resources

• https://github.com/iddi/sofia• What you would need:

• Eclipse for RCP and RAP Developers (Helios)• EGit• Android ADK (if Android is used)• SOFIA ADK• TUeSIB• Python (if python is preferred)• Smart-M3 Python KPI• SSLS• …• More at: https://github.com/iddi/sofia/wiki/Installation

Department of Industrial Design PAGE 6808-04-23

Resources

• SOFIA is based on SMART-M3• M3:  multi-vendor, multi-device and multi-part• About SMART-M3:

• http://en.wikipedia.org/wiki/Smart-M3• SMART-M3 on source forge:

• http://sourceforge.net/projects/smart-m3/

Department of Industrial Design PAGE 6908-04-23

Resources

• SOFIA is contunued:• https://sofia-community.com/

Department of Industrial Design PAGE 7008-04-23

References

Department of Industrial Design PAGE 7108-04-23

1. G. Niezen, ONTOLOGIES FOR INTERACTION: Enabling serendipitous interoperability in smart environments. PhD Thesis, Eindhoven University of Technology, 2012.

2. B. J. J. van der Vlist, Designing Semantic Connections Explorations, Theory and a Framework for Design. PhD Thesis, Eindhoven University of Technology, 2012.

3. B. J. J. van der Vlist, G. Niezen, S. Rapp, J. Hu, and L. M. G. Feijs, "Controlling Smart Home Environments with Semantic Connections: a Tangible and an AR Approach," presented at the 7th International Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand, 2012.

4. B. J. J. van der Vlist, J. Hu, G. Niezen, and L. M. G. Feijs, "Semantic Connections: a New Interaction Paradigm for Smart Environments," presented at the 7th International Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand, 2012.

5. J. P. A. Peeters, B. J. J. van der Vlist, G. Niezen, J. Hu, and L. M. G. Feijs, "A Study on a Tangible Interaction Approach to Managing Wireless Connections in a Smart Home Environment," presented at the 7th International Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand., 2012.

6. J. Hu, B. van der Vlist, G. Niezen, W. Willemsen, D. Willems, and L. Feijs, "Designing the Internet of Things for Learning Environmentally Responsible Behaviour," Interactive Learning Environments, vol. Accepted., 2012.

7. W. Willemsen, J. Hu, G. Niezen, and B. van der vlist, "Using Game Elements to Motivate Environmentally Responsible Behaviour," presented at the IADIS Game and Entertainment Technologies 2011 (GET 2011), Rome, Italy, 2011.

8. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Interaction primitives: Describing interaction capabilities of Smart Objects in ubiquitous computing environments," presented at the AFRICON, 2011, Livingstone 2011.

9. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Desiqn semantics of connections in a smart home environment," Creation and Design, vol. 13, pp. 18-24, 2011.

10. G. Niezen, B. van der vlist, J. Hu, and L. M. G. Feijs, "Using semantic transformers to enable interoperability between media devices in a ubiquitous computing environment," presented at the International Workshop on Self-managing Solutions for Smart Environments (S3E 2011) at the 6th International Conference on Grid and Pervasive Computing (GPC 2011), 2011.

11. M. Kwak, G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "Tangible Interfaces to Digital Connections, Centralized versus Decentralized," Transactions on Edutainment, vol. V, LNCS 6530, pp. 132-146, 2011.

12. J. Hu, B. van der vlist, G. Niezen, W. Willemsen, D. Willems, and L. M. G. Feijs, "Learning from Internet of Things for Improving Environmentally Responsible Behavior," in Edutainment Technologies. Educational Games and Virtual Reality/Augmented Reality Applications, M. Chang, W.-Y. Hwang, M.-P. Chen, and W. Müller, Eds., ed: Springer Berlin / Heidelberg, 2011, pp. 292-299.

13. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Design Semantics of Connections in a Smart Home Environment," presented at the Design and Semantics of Form and Movement (DeSForM 2010), Lucerne, Switzerland., 2010.

14. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Semantic Connections: Exploring and Manipulating Connections in Smart Spaces," presented at the 2010 IEEE Symposium on Computers and Communications (ISCC), Riccione, Italy, 2010.

15. G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "From Events to Goals: Supporting Semantic Interaction in Smart Environments," presented at the 2010 IEEE Symposium on Computers and Communications (ISCC), Riccione, Italy, 2010.

Smart Objects and Semantic Web: A semantic approach to intelligent environments

© 2012 Jun Hu