internet of things (iot)

BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

Internet of Things (IoT) Are traditional architectures good enough?

Guido Schmutz

Guido Schmutz

Working for Trivadis for more than 18 yearsOracle ACE Director for Fusion Middleware and SOACo-Author of different booksConsultant, Trainer Software Architect for Java, Oracle, SOA and Big Data / Fast DataMember of Trivadis Architecture BoardTechnology Manager @ Trivadis

More than 25 years of software development experience

Contact: [email protected]: http://guidoschmutz.wordpress.comTwitter: gschmutz

Unser Unternehmen.

Trivadis ist führend bei der IT-Beratung, der Systemintegration, dem Solution Engineering und der Erbringung von IT-Services mit Fokussierung auf - und -Technologien in der Schweiz, Deutschland, Österreich und Dänemark. Trivadis erbringt ihre Leistungen aus den strategischen Geschäftsfeldern:

Trivadis Services übernimmt den korrespondierenden Betrieb Ihrer IT Systeme.

B E T R I E B

KOPENHAGEN

MÜNCHEN

LAUSANNEBERN

ZÜRICHBRUGG

GENF

HAMBURG

DÜSSELDORF

FRANKFURT

STUTTGART

FREIBURG

BASEL

WIEN

Mit über 600 IT- und Fachexperten bei Ihnen vor Ort.

14 Trivadis Niederlassungen mitüber 600 Mitarbeitenden.

Über 200 Service Level Agreements.

Mehr als 4'000 Trainingsteilnehmer.

Forschungs- und Entwicklungsbudget: CHF 5.0 Mio.

Finanziell unabhängig undnachhaltig profitabel.

Erfahrung aus mehr als 1'900 Projekten pro Jahr bei über 800 Kunden.

Agenda

1. Introduction

2. Are Traditional Solution architectures good enough?3. IoT Architecture & Components

4. IoT Platforms

5. Summary

Introduction

Internet of Things Wave

Internet of Things (IoT): Enabling communication between devices, people & processes to exchange useful information & knowledge that create value for humans

Term was first proposed by Kevin Ashton in 1999

The concept of IoT first became popular at the Auto-ID center and MIT

IoT can also be named M2M

Reasons why IoT opportunity is occurring now ?

Affordable hardware

• Costs of actuators & sensors have been cut in half over last 10 years

Smaller, but more powerful hardware

• Form factors of hardware have shrunk to millimeter or even nanometer levels

Ubiquitous & cheap mobility

• Cost for mobile devices, bandwidth and data processing has declined as much as 97% over last 10 years

Availability of supporting tools

• Big data tools & cloud based infrastructure have become widely available and fairly sophisticated

Mass market awareness

• IoT has surpassed a critical tipping point• Vision of a connected world has reached such a

followership that companies have initiated IoTdevelopments

• Commitment is irreversible

IoT Solution Types

AdaptedfromGartner

AnalyticsApplicationUserInterface

Enterprise/On-Premise

Cloud-based

Gateway

Thing

Thing-centric Gateway-centric Smartphone-centric Cloud-centric Enterprise-centric

Sensor Data

IoT Solution Types

Thing-centric

q Things are smart on their own

q store most of their data on-board

q Things are self-sufficient and communicate to the Internet only for centralized coordination

Gateway-centric

q gateway houses the application logic, stores data and communicates with the Internet for the things that are connected to it

q Things don’t have to be as smart, because the gateway provides these resources

IoT Solution Types

Smartphone-centric

q The smartphone (or any mobile device) houses the application logic, stores data and communicates with the Internet for the things that are connected to it

q Things don’t have to be as smart, because the smartphone provides these resources

Cloud-centric

q The cloud will act as the central connection hub, power analytics and provision data storage

q Things don’t have to be as smart, because the cloud will provide these resources

Enterprise-centric

q Things are behind a firewall and are geographically co-located

q There is little need to extend out to the external Internet

Are Traditional Solution architectures good enough?

A little story of a “real-life” customer situation

Traditional system interact with its clients and does its workImplemented using legacy technologies (i.e. PL/SQL)

New requirement:• Offer notification service to notify

customer when goods are shipped• Subscription and inform over different

channels• Existing technology doesn’t fit

delivery

LogisticSystem

Oracle

Mobile Apps

Sensor ship

sort

16

Rich(Web)Client Apps

DB

schedule

Logic(PL/SQL)

delivery


Events are “owned” by traditional application (as well as the channels they are transported over)

Implement notification as a new Java-based application/system

But we need the events ! => so let’s integrate

delivery

LogisticSystem

Oracle

Mobile Apps

Sensor ship

sort

17


DB

schedule

Notification

Logic(PL/SQL)

Logic(Java)delivery

SMS

Email

…


integrate in order to get the information! Oracle Service Bus was already there

Rule Engine implemented in Java and invoked from OSB message flowNotification system informed via queueHigher Latency introduced (good enough in this case)

delivery

LogisticSystem

OracleOracle

ServiceBus

Mobile Apps

Sensor AQship

sort

18


DB

schedule

Filter

Notification

Logic(PL/SQL)

JMS

RuleEngine(Java)

Logic(Java)delivery

shipdelivery

delivery true SMS

Email

…


Treat events as first-class citizens

Events belong to the “enterprise” and not an individual system => Catalog of Events similar to Catalog of Services/APIs !!

Event (stream) processing can be introduced and by that latency reduced!

delivery

LogisticSystem

OracleOracle

ServiceBus

Mobile Apps

Sensor AQship

sort

19


DB

schedule

Filter

Notification

Logic(PL/SQL)

JMS

RuleEngine(Java)

Logic(Java)delivery

shipdelivery

delivery true SMS

Email

…

Treat Events as Events and make them globally available

delivery

LogisticSystem

Oracle

OracleServiceBus

Mobile Apps

Sensorship

sort

20


DB

schedule

Filter

Notification

Logic(PL/SQL)

JMS

RuleEngine(Java)

Logic(Java)

delivery

ship

delivery true SMS

Email

…

EventBus/Hub

Stream/EventProcessing

IoT Architecture

Key Challenges for building an IoT application

Connect: How to collect data from intelligent devices?

• Abstract complexity associated with device connectivity• Standardize integration of devices with enterprise

Analyze: How to analyze IoT data?

• Reduce noise and detect business event at real-time• Enable historical big-data analysis

Integrate: How to integrate IoT data & events with enterprise infrastructure?

• Make enterprise processes IoT friendly• Allow enterprise & mobile applications to control devices

Distribute runtime portion of IoT Analytics to the edge

Some IoT Analytics applications need to be distributed, so that processing can take place in devices, gateways, smart routers, servers at the site where sensor data is generated

Three main reasons:

• The factory, vehicle, home or other edge location needs to stay in operation, even when the corporate data center or cloud is down or not reachable

• Wide-are communication is generally to slow

• Transmitting all sensor data to corporate or cloud data center may be impractical or impossible if the volume of data is high or if reliable, high-bandwidth networks are unavailable

Data and IoT

Several types of data play a role in an IoT deployment:• Continuous environmental and positional data

• Multidimensional time series data

• Descriptive data (metadata) about objects, systems and processes

• Historical data

• Analytical models

• Radio frequency identification (RFID) data

Assess the variety of data used in your IoT architecture to refine your datastore requirements => NoSQL

Understand the unique optimizations for time series data and analysis => NoSQL

EnterpriseService

Bus(E

SB)

EnterpriseApplications

WS

External CloudServiceProviders

BPMandSOAPlatform

Event

BusinessLogic/Rules

Business IntelligenceIoT Device

Services

WS

Event

Processes

Gateway

IoT SmartDevice

Viszualization

Analytics

DB

1) IoT with Simple Event Processing

APIG

atew

ay

=oneway=request/response

25

Mobile Apps

DB


DB

EnterpriseService

Bus(E

SB)


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules


Services

WS

Event

Processes

Gateway

IoT SmartDevice

Viszualization

Analytics

DB

1) IoT with Simple Event Processing – Oracle

APIG

atew

ay


26

Mobile Apps

DB


DB

Seriv

ceBu

s

APIG

atew

ay

StreamExplorer

Business ActivityMonitoring

SOASuiteBPMSuite

EnterpriseService

Bus(E

SB)

StreamProcessingInfrastructure


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules


EnterpriseEventBus(Ingress)

Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP

ESP/CEP

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

2) IoT with Stream/Event Processing

APIG

atew

ay

27

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP

ESP/CEP

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

2) IoT with Stream/Event Processing – “Open Source”

APIG

atew

ay

28

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP

ESP/CEP

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

2) IoT with Stream/Event Processing - Oracle

APIG

atew

ay

29

Mobile Apps

DB


DB

Social MediaStreams


OracleEventProcessingForEmbedded


Seriv

ceBu

s

OracleEventProcessingStreamExplorer

OracleNoSQLStreamExplorer

Business ActivityMonitoringSe

rivce

Bus

APIG

atew

ay

Coherence

SOASuiteBPMSuite

EnterpriseService

Bus(E

SB)

3) IoT with Big Data Analytics


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP

Hadoop BigDataInfrastructureHDFS

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DBDB

APIG

atew

ay

30

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DBDB

APIG

atew

ay

31

Mobile Apps

DB


DB

Social MediaStreams


3) IoT with Big Data Analytics – “Open Source”

EnterpriseService

Bus(E

SB)

3) IoT with Big Data Analytics - Oracle


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DBDB

APIG

atew

ay

32

Mobile Apps

DB


DB

Social MediaStreams




Seriv

ceBu

s

OracleBigData Appliance

OracleNoSQL

StreamExplorer


OracleDataIntegrator

APIG

atew

ay SOASuiteBPMSuite

EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

DB

4) IoT with “Lambda” Architecture

APIG

atew

ay

33

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

Replay toreprocess

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

5) IoT with “Kappa” Architecture

APIG

atew

ay

34

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

DB

6) IoT with Big Data Advanced Analytics

APIG

atew

ay

35

Mobile Apps

DB


DB

Social MediaStreams


EnterpriseService

Bus(E

SB)


IoT Reference Architecture


WS


BPMandSOAPlatform

Event

BusinessLogic/Rules


36

Mobile Apps

DB


DB

Social MediaStreams En

terpriseEventBus(Ingress)

Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

DB

APIG

atew

ay


EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules


37

Mobile Apps

DB


DB



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

DB

APIG

atew

ay

Internet of Things - Sind traditionelle Architekturen gut genug?


IoT Reference Architecture – Open Source Platform

EnterpriseService

Bus(E

SB)



WS


BPMandSOAPlatform

Event

BusinessLogic/Rules


38

Mobile Apps

DB


DB



Enterprise

EventBus

Services

WS

Event

Processes

Gateway

ESP/CEP


ESP/CEP

BatchProcessing

IoT SmartDevice

Viszualization

Analytics

DB

DB

DB

DB

APIG

atew

ay

IoT Reference Architecture – Oracle Platform

Internet of Things - Sind traditionelle Architekturen gut genug?




Seriv

ceBu

s

OracleEventProcessingStreamExplorer

OracleBigData Appliance

OracleNoSQL

OracleNoSQL

StreamExplorer


OracleDataIntegrator

Seriv

ceBu

sAP

IGatew

ay

Coherence

SOASuiteBPMSuite

IoT Platform

IoT Platforms: backbone to manage IoT business cases

Mayor building blocks of an IoT Platform

OracleInternetofThingsCloudService

IoTCloudService

DeviceVirtualization

High SpeedMessaging

EndpointManagement

Connect

Abstractcomplexityassociatedwithdeviceconnectivity

Standardize integrationofdeviceswithenterprise

AnalyzeReducenoiseanddetectbusiness

eventsatreal-timeEnablehistoricalbig-dataanalysis

IntegrateMakeenterpriseprocessesIoT

friendlyAllowenterprise&mobile

applications tocontroldevices

Integration CloudService

BI&Big DataCloudService

OracleCloudServices

MobileCloudService

3rd partyapps

IndustryVertical Apps

Enterprise AppsCloudorOnPremise

Manufacturing

Transportation

ServiceMgmt

AssetMgmt

EnterpriseConnectivity

RESTAPIs

Control

StreamProcessing

EventStore

DataEnrichment

Summary

Summary

Treat events as events! Infrastructures for handling lots of events are available!

IoT tends to make Big Data / Fast Data infrastructures necessary

Know your use case/requirements to choose the right architecture!Can my existing backend landscape handle the new IoT load?

Do I have to handle huge amount of events in “real-time”?

Do I need to filter/aggregate data before invoking existing backend systems?

Do I want to do Advanced Analytics (predictive analytics) where historical information is necessary?

What is the network bandwidth between device/gateway and cloud/backend?

Centralized or Decentralized IoT solution?

Trivadis anderDOAG2015

Ebene3- gleichnebenderRolltreppe

WirfreuenunsaufIhrenBesuch.

DennmitTrivadis gewinnenSieimmer.

Guido SchmutzTechnology Manager

[email protected]

internet of things (iot)

Presentations & Public Speaking