context aware and device dependent interaction in smart ... · goal: an intelligent notification...

30
Context Aware and Device Dependent Interaction in Smart Environments Supervisors: Fulvio Corno Dario Bonino Luigi De Russis Candidate: Emanuele Furci Politecnico di Torino Master degree in Computer Engineering Academic year 2013-2014

Upload: others

Post on 25-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Context Aware and Device

Dependent Interaction

in Smart Environments

Supervisors:

Fulvio Corno

Dario Bonino

Luigi De Russis

Candidate:

Emanuele Furci

Politecnico di Torino

Master degree in

Computer Engineering

Academic year 2013-2014

Page 2: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Outline

Introduction

Thesis work

Data Modelling

Software Development

Scenario Test Case

Conclusions

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

2

Page 3: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Goal:

An intelligent notification system for smart

homes

Take into account the surrounding context to

select end user devices and send them

generated messages

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

3

Page 4: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

4

Page 5: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Steps:

create a data modelling infrastructure able to

represent information about the context (domain

of interest)

develop a software to elaborate data model

information and deliver house related messages

to the appropriate end users device

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

5

Page 6: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Data Modelling

Politecnico di Torino

Master degree in

Computer Engineering

Page 7: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Data Modelling

Definition of the Domain of Interest

Users

User Devices

Smart Home

Message Categories

Ontology-Based Modelling

Exploration of existing ontology for

contex modelling

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

7

Page 8: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont

the Notification Ontology

4 directly imported ontologies

Locont

Device

DogOnt

Core

27 overall imported ontologies

1385 classes

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

8

Page 9: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont – User Modelling

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

Activity (e.g. eating, sleeping)

Accessibility (e.g. freeable_hands)

Location (e.g. livingroom, kitchen)

Obtrusiveness (e.g. mobile_only, no_audio)

End-User-Devices (e.g. smartphone, tablet)

Message Categories (e.g. AppliancesAlert)

9

Page 10: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont – Device Modelling

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

Physical Features (e.g. screen size, camera)

Capabilities (e.g. audio and video

reproduction)

10

Page 11: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont – House Modelling

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

Architectural aspects (e.g. wall, window)

Appliances (e.g. oven, HVAC system)

Devices (e.g. smart tv, HiFi system)

Furniture (e.g. couch, table)

11

Page 12: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont – Message Category

Modelling

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

Priority (e.g. lower_level, highest_level)

Attributes (e.g. min_temperature_value)

12

Page 13: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont – Information modelling

Introduction – Data Modelling – Software Development – Experimental Results - Conclusions

Information as Class instance

Instance data properties

Connections by means of object properties

A single .owl file as data model

13

Page 14: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Scenario Test Case

2 users (Luca, Giulia)

3 devices (LG Nexus 4, Samsung Galaxy

Nexus, Samsung Galaxy Tab 10’’)

1 smart home (temperature and humidity

sensors, smart plugs, door sensors,Hifi system)

6 message category (EnvironmentalComfort,

PowerOverThreshold, EnergyManagement,

AppliancesUsage, AppliancesAlert,

SecurityAlert)

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

14

Page 15: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Software Development

Politecnico di Torino

Master degree in

Computer Engineering

Page 16: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Software Development

Data Model Management

Notont Manager

User Interfacing

UserManager

House Interfacing and Message Generation

House Message Manager

Device Message Delivery

Device Manager

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

16

Page 17: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

NINS: Notont-based

Intelligent Notification System

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

17

• Data Model Management

• Insert

• Update

• Delete

• Query

• Implements the device inferring

process

• Update User State

(Obtrusiveness level, Location,

etc)

• Assumptions:

• User Activity and Location

are known • Receive Generated

Messages

• Get end user Devices from

Notont Manager

• Send Messages to Devices

• Receive Generated

Messages

• Get end user Devices from

Notont Manager

• Send Messages to Devices

Page 18: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

NINS – Device Manager

Android – Based

Devices

Gcm Service

Mobile application

on Devices

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

22

Page 19: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Scenario Test Case

Politecnico di Torino

Master degree in

Computer Engineering

Page 20: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Scenario Test Case

2 users (Luca, Giulia)

3 devices (LG Nexus 4, Samsung Galaxy

Nexus, Samsung Galaxy Tab 10’’)

1 smart home (temperature and humidity

sensors, smart plugs, door sensors,Hifi system)

6 message category (EnvironmentalComfort,

PowerOverThreshold, EnergyManagement,

AppliancesUsage, AppliancesAlert,

SecurityAlert)

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

24

Page 21: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Video

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

25

Page 22: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Conclusions

Politecnico di Torino

Master degree in

Computer Engineering

Page 23: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Conclusions

Notont – Notification Ontology

Formal representation of context information in

Smart Environments

Inferring of the most suitable end user device

NINS – Notont-based Intelligent Notification

System

Data model Management

House and User interfecing

Sending messages to devices

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

27

Page 24: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Future Works

Test in a real home setting

Usage of the context to infer “how” send a

message to end users devices

Increase supported devices

Introduction – Data Modelling – Software Development – Scenario Test Case - Conclusions

28

Page 25: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Thank You!

Politecnico di Torino

Master degree in

Computer Engineering

Page 26: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont

the Notification Ontology

Extra Slides

30

Page 27: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Notont & scenario modelling

Extra Slides

31

Page 28: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Scenario: Giulia modelling

Extra Slides

32

Page 29: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Query the model – Giulia’s

activity

Extra Slides

33

Page 30: Context Aware and Device Dependent Interaction in Smart ... · Goal: An intelligent notification system for smart homes Take into account the surrounding context to select end user

Android user application

Extra Slides

34