(arc306) iot: small things and the cloud | aws re:invent 2014

ARC 306

IoT: Small Things and the Cloud

Brett Francis, Solutions Architecture

November 12, 2014 | Las Vegas, NV

What is a Small Thing?

What is a Small Thing?Why

Small Things maximize

a resource by using it

as little as possible.

Define: Resource constrained computing thing

• Devices constrained in at least one

computing dimension

• Regularly deployed at counts in the

thousands or more

• May play critical roles without human

interaction

IoT and Small Thing comparisons

Not a Small Thing A Small Thing

A Small Thing is connected but

inherently limited in some way.

Almost everywhere a

Small Thing has a gap…

…a globally accessible cloud

platform helps fill the gaps.

The smaller the device is,

the bigger the data

…and the newer the challenges.

Let’s explore…

Gap Gap

Filling in some gaps

First challenge: telemetry

IoT : [ Telemetry ][ Commands ][ Device DevOps ][ Audit & Authorization ]

Telemetry today

Remotely determine what a device

senses.

Telemetry misconception

“Just gather the sensor data and

send it in for use.”

AWS Cloud

Archive

Correlation

Analysis

Device

Config

Device

Config

Master Device

Config

M2M BrokerScaling Group

Rivers of data become Big Data

My Photo Dump.

Gap Gap

Small thing telemetry — AWS helps

Global Ubiquity

$0 Inbound Data

Elasticity

Purpose Built Services

Amazon

DynamoDB

Amazon

Kinesis

Amazon

Scaling

Next challenge: commands

Commands today

Ask a device to do something.

Commands misconception

“Just tell those devices to do

something.”

(2) Get Command(s)

(1) Get Config

Basic commands + cloud architecture

AWS Cloud

Just tell those devices to do something.

Mobile Devices

Web App

Device

Config

Small Thing

Configured

Command

Source

Device

Commands

M2M Endpoints

HTTPS orM2M Protocol

(B) User Commands

(A) Configured

Device Pair

…or…

Various Sensors

Real world Command challenges

Sending the correct commands matter

• Delivery of authoritative commands

• Minimal-connection delivery

• Important commands to be transactional

Evolved command connections

Single High-Heat NoSQL Database Meet-Me M2M Broker Endpoint Pools

(3) Write Command SUCCESS

Device

Commands

(2) Read Command(s) from Table

(1) Get Config

Device

Config

Small Thing

Configured

Command

Source

Device

Commands

(2) Read Command(s) from Topic

(1) Get Config

Device

Config

Small Thing

Configured

Command

Source

Meet-Me M2M Endpoints

Evolved commands + cloud architecture

Device

Commands

(2) Read Command(s) from Table

(1) Get Config

Device

Config

Small Thing

Configured

Command

Source

Device

Commands

Mobile Devices

Web App

(C) User Commands

(B) Get Configured

Device Pair

Amazon

Cognito

Authorization

(A) Mobile User

Authorization

Gap Gap

Commands — AWS helps

Global Ubiquity

$0 Inbound Data

Elasticity

Amazon

DynamoDB

Amazon

CognitoAuto

Scaling

Next challenge: Device DevOps

Device DevOps today

Ask a device to be something new.

Device DevOps misconception

“Just send out firmware updates

when needed.”

Basic DevOps + cloud architecture

Just send out firmware updates when needed.

(2) Get Firmware Bundle(s)

(1) Get Command

AWS Cloud

Device

Commands

Small Thing

Firmware

Bundle

Bundle Download

Device Specific

BundleVarious Sensors

Real world Device DevOps challenges

If you kill it, it is dead

Hundreds of thousands of devices need help with:

• Intelligent exception management

• Staged, validated, and rolling updates

Evolved DevOps + cloud architecture

(1) Get Config

AWS Cloud

Device

Commands

Small Thing

Configured

Firmware

Bundle

Bundle Download

Device Specific

Bundle

(3) Send Firmware SUCCESS

Device

Commands

Various Sensors

Evolved Device DevOps process arch

(1) Get Command

Device

Commands

Small Thing

Device Specific

Bundle

Device

Commands

Small Thing

All Success?

(1) Get Command

Device

Commands

Device Specific

Bundle

Device

Commands

StagingProduction

LoggerSmall Thing

(B) Copy Bundle

(C) Update Commands

Various Sensors

(A) Validate Bundle

All Success?

(D) Manage Exceptions

Device DevOps — AWS helps

Global Ubiquity

$0 Inbound Data

Elasticity

Amazon

DynamoDB

Amazon

Global

Object

Last challenge: audit & authorization

Audit & authorization today

Determine if a device should be

allowed to do something.

Audit & authorization misconception

“Just allow the right devices to do

something.”

Basic audit & authorization + cloud arch

(2) Authenticate and Authorize

AWS Cloud

Small Thing

(3) Register

Device

Registration

(4) Proceed with Privilege

Device

Config

(1) Install Creds

Just allow the right devices to do something.

Real world audit and authorization challenges

• Intelligent exception management

• Resource constrained authorization

• Device authorization and renewal

(1) Get Cognito ID

Evolved Audit & Authorization + Cloud Arch

AWS Cloud

Just allow the right devices to do something.

Small Thing

Cognito

AuthorizationCognito ID

(2) Unauthenticated Register

Device

Registration

(3) Authorize Device

Device

Registration

Web AppUsers & Admins

Audit & authorization — AWS helps

Global Ubiquity

$0 Inbound Data

Elasticity

Global

Object

AZNAmazon

CognitoDynamoDB

Small Things — AWS helps

Global Ubiquity

$0 Inbound Data

Elasticity

Global

Object

AZN Amazon

Amazon

CognitoAmazon

DynamoDB

Amazon

Kinesis

Amazon

Scaling

A Small Thing solution architecture

Pragma architecture(“Pragma” is Greek for “thing”)

Serving LayerIntermittent Layer

Speed Layer

Telemetry

Commands

Device DevOps

Audit & Authorization

Web Apps

How do I get started?

• Open an AWS account

– https://portal.aws.amazon.com/gp/aws/developer/registration/index.html

• Explore the AWS IoT mini-site

– http://aws.amazon.com/iot/

• Explore Amazon Cognito: http://aws.amazon.com/cognito/

• Explore Amazon Kinesis: http://aws.amazon.com/kinesis/

• Explore DynamoDB: http://aws.amazon.com/dynamodb/

• After re:Invent, download this deck

http://bit.ly/awsevals

Serving LayerIntermittent Layer

Speed Layer

Telemetry

Commands

Device DevOps

Audit & AZNSmall

Pragma Architecture(“Pragma” is Greek for “thing”)

brettf@amazon.com

Thank You

Appendix

Pragma architecture characteristics

• The intermittent layer is the control point for access to the

speed layer.

• The intermittent layer acts as the nexus of fleet management,

supports high-heat data interactions.

• The speed layer acts as the inbound high-bandwidth data bus

and the outbound command bus.

• The serving layer enables applications to interact with archive,

analysis, correlation, and real-time views of the device fleet.

• The serving layer enables the intermittent layer to distribute

and control updates.

(arc306) iot: small things and the cloud | aws re:invent 2014

Technology

aws re:invent 2017 re:view

aws re:invent hackathon

aws re:invent 2016 fast forward

zero to sixty: aws opsworks (dmg202) | aws re:invent 2013

(web305) migrating your website to aws | aws re:invent 2014

aws re:invent 2016: new launch! introducing aws greengrass...

aws re:invent 2016: the effective aws cli user (dev402)

aws re:invent 2016: event handling at scale: designing an...

aws re:invent - accelerating research

bluesoft @ aws re:invent 2017 + aws 101

aws opsworks under the hood (dmg304) | aws re:invent 2013

mobile game architectures on aws (mbl201) | aws re:invent...

(pfc302) performance benchmarking on aws | aws re:invent...

aws security ideas - re:invent 2016

aws re:invent re:flection - spot pricing

aws re:invent 2016: what’s new with aws lambda (svr202)

migrating my.t-mobile.com to aws (ent214) | aws re:invent...

aws re:invent 2015 re:cap

aws re:invent 2016: large-scale aws migrations (ent204)

aws security – keynote address (sec101) | aws re:invent...