unlocking the power of iot through big data · key areas of focus for gsma 2017/2018 14 evolve iot...

23
Unlocking the power of IoT through Big Data IoThings NOW – Milan May 2017 Barbara Pareglio – GSMA IoT Technical Director

Upload: others

Post on 20-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Unlocking the power of IoT through

Big Data

IoThings NOW – Milan May 2017Barbara Pareglio – GSMA IoT Technical Director

Page 2: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Introduction of the GSMA

2

Page 3: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

3

Source: Internet of Things Study 2016, Evans Data Corporation

IoT challenges for Developers

Page 4: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Expect we will be flooded in data

but how usable will it be?

Some of the challenges

Device protocols/ APIs

Context data protocols (JSON/

CSV/ XML etc)

Knowing the accuracy of devices

Consistency of units

Device reliability

Device stability

Finding the data

The Challenge of Data set Diversity

4

Page 5: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

The problem … at an EU level

5

Page 6: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

So I want to study air quality across the EU?

6

Page 7: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

What about the UK? Air Quality

7

Page 8: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

What about the UK? Total government datasets

8

Page 9: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

What about the UK? Air Quality

9

Page 10: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Obtaining 14 months of hourly weather observations for two London

weather stations took … 559 minutes elapsed

Even though this amounts to just 1.5 Mb of data

Each hourly data point was obtained by submitting a form, parsing the HTML

response, downloading a CSV file and reading the contents

Approximately 20 minutes per month of data per weather station

There are ‘approximately’ 140 Met Office weather observation sites across

the UK

So downloading 5 years of historical weather observations for the whole of the UK

would take an estimated 168,000 minutes, or 2,800 hours or 116 days!

Also it took a few days to implement a resilient method to download the data

due to the server being unstable

Another experience with historical weather data from the

Met Office

10

Page 11: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

EACH developer has to

Search for potentially useful data

Assess every data source for usefulness i.e. does it contain the data they

want

Assess every data source / data feed for quality / quirks

Work out how to access the data e.g. do they need to register on a

developer programme, accept a license, obtain access keys

Implement a ‘connector’ to the source e.g. FTP/HTTP, API, CSV/ XML/ PDF/

KML

Sanitise the data e.g. deal with nulls or values that represent ‘no reading’

Ensure the data units are consistent with other data

What is the impact?

11

Page 12: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

The IoT Big Data ecosystem shift

IoT TODAY

Disparate systems

Silos of heterogeneous data

Valuable data

Innovation

VISION FOR IoT

Sharing of data with greater consistency

Common ecosystem enablers

Data / service monetisation

Increased innovation

12

Page 13: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

13

GSMA IoT Big Data Vision

Creation of new business models, products and services by

applying various capabilities, such as mash-up and analytics, to

IoT and context data captured from multiple sources“

“ Enable an ecosystem, including mobile operators and other players,

through which data can be harmonised and shared from multiple

sources

Develop new commercial products and services by applying

capabilities to harmonised IoT and context data

Page 14: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Key areas of focus for GSMA 2017/2018

14

Evolve IoT Big Data enablersImplementation and ecosystem

adoption

Proof of Concept demonstrating

operator value generation

Evolve common API to address

requirement for historical data

analysis and linked data

Evolve IoT Big Data architecture to

address areas such as analytics

Expand harmonised entities and

APIs

Evolve IoT Big Data Directory to

foster developer engagement and

showcasing of applications

Implementation of common enablers

(e.g. APIs, data entities)

Drive adoption through developer

programmes and partnerships

Liaison with industry bodies (e.g.

ETSI, FIWARE, schema.org) to drive

ecosystem adoption of common

approach

Create a live proof of concept utilising

the industry agreed IoT Big Data

enablers

Develop a guide describing how value

can be generated by this service and

the value of the common enablers

Define solution design for at least one

Social Development Goal Big Data for

Good initiative

Page 15: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

15

IoT Big Data Use Cases

Utility

Utility metering

Smart grid

Agriculture

Farms

Greenhouses

Environment

Air quality

Water quality

Weather

Smart Cities

Transport

Parking

Waste management

Automotive

Vehicle

Faults

Page 16: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

16

Particular Challenges for IoT/Big Data

The potential scale of data being stored, processed or queried given

The number of IoT devices and update frequency

Combining current / historical IoT data with external data

Managing privacy issues including consent, aggregation, anonymisation

The large variety of devices in the field where each vendor/ device type

might have its own specific interface

Differences in device attributes – names, units etc - even where the device

is reasonably generic

Page 17: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Initial proprietary interfaces (I2) will be

augmented with OneM2M

Substantial simplification of

interfacing layers

Gateways handle local data

acquisition & control

Dedicated IoT applications delivered

using oneM2M stack

Hybrid architecture supports richer

applications stack including advanced

analytics, visualisation, machine learning

Applications which span broader set

of devices and context data

Data transformation/ storage to be

used in rich analytics/ machine

learning

AE

CSE

NSE

Mca

Mcn

oneM2M

Functional

Architecture

I2 = Mca

Technical Architecture Framework

17

Page 18: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Create an entity including one or more

attributes;

Retrieve entity (/specified attribute`s) by

entity identifier;

Update one or more attributes of an existing

identity;

Remove an entity;

Get an attribute value;

Update an attribute value;

Remove an attribute of an entity;

List entities matching specified criteria;

List known entity types;

Retrieve entity type information;

Create a subscription;

List subscriptions;

Retrieve details of a subscription;

Update details of a subscription;

Delete a subscription;

Batch update;

Batch query.

18

Interface Operations

Page 19: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

19

Agriculture

AgriCrop

AgriGreenHouse

AgriParcel

AgriParcelRecord

AgriParcelOperation

AgriPest

AgriProduct

AgriProductType

AgriSoil

Environment

AirQuality

EnvironmentObserved

PointOfInterest

WaterQuality

WeatherForecast

WeatherObserved

Smart Home

Building

BuildingType

BuildingRecord

BuildingRecordType

Connected Car /Smart

Cities

Vehicle

VehicleType

VehicleFault

Road

RoadSegment

General IoT

Device

DeviceRecord

DeviceRecordType

Machine

MachineType

Subscriber

SubscriptionService

Entity definitions published at : https://github.com/GSMADeveloper/HarmonisedEntityDefinitions

Harmonised Data Entities

Page 20: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

GSMA has published three technical documents defining the

approach for delivery of IoT Big Data services to the general

third party application developer ecosystem

1. Technical Architecture Framework

2. API Specification for Data & Control exposure towards third

party applications

3. Initial set of Harmonised Entity Definitions

Documents available from: http://www.gsma.com/iot/iot-big-

data/

20

GSMA Technical Documentation

Page 21: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

21

How to Participate

We welcome ecosystem participants to participate in the project and lay the

foundations for the provision of global data-driven IoT services.

[email protected]

http://www.gsma.com/iot/iot-big-data/

Page 22: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

How does the GSMA support the IoT

Mobile IoT

Accelerate availability of

standard LPWA

solutions in licensed

spectrum (EC-GSM-IoT,

LTE M, NB-IoT)

IoT Business Enablers

Enable operators to capture the

Internet of Things opportunity, by

fostering relevant, flexible and

technology-neutral policies and

regulation

IoT Security

Help IoT Ecosystem

providers to protect

themselves from

cybersecurity threats

(Guidelines & Self-

Assestment)

IoT Big Data

Harmonised data sets

from multiple sources

available to developers

and third parties through

common APIs.

Smart Cities

The GSMA is working with all

stakeholders to agree a common

approach to smart city solutions

with long term benefits to citizens

and businesses.

22

Page 23: Unlocking the power of IoT through Big Data · Key areas of focus for GSMA 2017/2018 14 Evolve IoT Big Data enablers Implementation and ecosystem adoption Proof of Concept demonstrating

Thank You

For more information:

http://www.gsma.com/iot/iot-big-data/