serverless: an update from the field...api gateway cache api gateway cloudwatch lambda functions ec2...

Serverless: An Update From the Field

Danilo Poccia, Technical Evangelist @danilop

danilop

Virtual Machines Containers Functions

AMI Hours to Months Patching Multi-Threaded Multi-Task

Per VM Per Hour

The World Of Virtual Machines

Container File Minutes to Days Versioning Multi-Threaded Single-Task

Per VM Per Hour

The World Of Containers

Code Microseconds to Seconds

Versioning Single-Threaded Single-Task

Per Memory/Second Per Request

Free Tier

The World of Lambda Functions

No server is easier to manage than no server

Serverless Computing

Low Cost

SecuritySimplicity Reliability

Scalability Low Latency

S3: Simple By Name, Simple By Nature

Mobile Apps

Websites

Services

Internet

API Gateway Cache

API Gateway

CloudWatch

Lambda Functions

EC2 Endpoints

Any Other Endpoint

Amazon API Gateway

Building An Infinitely Scalable Online Recording CampaignFor David Guetta & UEFA

Credit: Gerry Cranham/Fox Photos/Getty Images http://www.telegraph.co.uk/travel/destinations/europe/united-kingdom/england/london/galleries/The-history-of-the-Tube-in-pictures-150-years-of-London-Underground/1939-ticket-examin/

Credit: Gerry Cranham/Fox Photos/Getty Images http://www.telegraph.co.uk/travel/destinations/europe/united-kingdom/england/london/galleries/The-history-of-the-Tube-in-pictures-150-years-of-London-Underground/1939-ticket-examin/

1939 London Underground

AWSIoT

KinesisStream

AWSLambda

DynamoDBTable

S3Bucket

Name

Email

Create New User

Submit

Check the “Name” syntax is right (only letters and spaces)

Check the “Email” syntax is right ([email protected])

Create the new user using provided Name and Email

User Interface Actions

Name

Email

Create New User

Submit

Check the “Name” syntax is right (only letters and spaces)

Check the “Email” syntax is right ([email protected])

Create the new user using provided Name and Email

User Interface ActionsObservers

Target Action

Generate thumbnails

Keep another database in sync

Process streaming data

Services FunctionsPlatform

Target Action

KinesisStream

DynamoDBTable

S3Bucket

area = length x widtharea = length x width

Procedural Programming“This is a function!”


Procedural Programming“This is a function!”

Reactive Programming“This is data binding!”


A B

Event-Driven DesignA triggers B

orB is caused by A

A B

C

D

New Services (C, D)are triggered by B

A B

C

D

E

F

?

?

What triggersnew services (E, F)?

What is causing E and F?

A B

C

D

E

F

New Services (E, F)are triggered by C

A B

C

D

E

F

It can be cyclic

Think ofacknowledgements

A B

C

D

E

F

Each servicehas local visibility

A B

C

D

E

F

What I need to know(input events)

A B

C

D

E

F

What I need to do(internal logic)

A B

C

D

E

F

Who I need to notify(output events)

A B

C

D

E

F

Who I need to notify(output events)

What I need to know(input events)

What I need to do(internal logic)

Distributed Data FlowVs

Centralised Workflow

ChoreographyVs

Orchestration

Distributed Systems

Monolith

Service

Service

μ

μ

μ

space (distribution, mobility)

time(

conc

urre

ncy,

late

ncy)

μ

μ

μ

μ

Distributedin Time and Space

[Jonas Bonér]

“…a diagram oftwo microservices

and their shared database”

A

C

I

D

tomic

onsistent

isolated

urable

A

C

I

D

tomic

onsistent

isolated

urable

A

C

I

D

ssociative

commutative

dempotent

istributed

ACID 2.0

A B

C

D

E

F

Event-Driven Interactions replacing Distributed Transactionsusing Eventual Consistency

Differentiate readsfrom writes (commands),

as in the Command QueryResponsibility Segregation

(CQRS) pattern

Customers Orders

Warehouse Deliveries

Payments

Catalog

Event-Driven Interactions replacing Distributed Transactionsusing Eventual Consistency

Responsive

ResilientElastic

Message Driven

The Reactive Manifesto

The Reactive Manifesto

Asynchronouscommunicationis not enforced

by serverless architectures

Responsive

ResilientElastic

Message Driven

Serverless Architectural Patterns

AWSLambdaUser Client

Application

Back End for a Web (HTML/JavaScript) or Mobile AppCalling the Lambda API directly

Web or Mobile Back End

DynamoDBTable

S3Bucket

AmazonCognito

AWSLambda

AmazonCognito

User ClientApplication

OAuth JWT

AmazonAPI Gateway

(HTTPS)

Back End for a Web (HTML/JavaScript) or Mobile AppUsing an API Gateway for authentication and decoupling

Web or Mobile Back EndVia API Gateway

DynamoDBTable

S3Bucket

AWSLambdaUser Client

Application

Using WebSockets instead of Web API to talk to the Back End

AWS IoT(MQTT over

WebSockets)

WebSockets Back End

DynamoDBTable

S3Bucket

AmazonCognito

MQTT orDevice

Shadow

Possible optimisations depending on your data flowand your acceptable latency

DataSource

KinesisStream

KinesisFirehoseKinesis

Analytics(improve & aggregate)

AWSLambda(batch)

S3Bucket

AWSLambda

(file)

Data Streams Processing

AWSLambda(batch)

AmazonCognito


Buffering Requests to the Back End to reduce Lambda invocations

KinesisStream

Buffered Back EndFor Mobile

AmazonSNS

DynamoDBTable

S3Bucket

AWSLambda(batch)


Using WebSockets instead of Web API to talk to the Back EndBuffering Requests to reduce Lambda invocations

AWS IoT(MQTT over

WebSockets)KinesisStream

Buffered Back EndFor Everything

MQTT orDevice Shadow

AmazonCognito

DynamoDBTable

S3Bucket


Using WebSockets instead of Web API to talk to the Back EndBuffering Requests to reduce Lambda invocations

Storing all customer interactions for further analysis

AWS IoT(MQTT over

WebSockets)Kinesis

Firehose

Buffered Back EndSaving Interactions

MQTT orDevice Shadow

AmazonCognito

AWSLambda

(file)S3

Bucket

DynamoDBTable

AWSLambda

DynamoDBTable


AmazonAPI Gateway

(HTTPS)

S3 Bucket(Website HostingRouting Rules)

For example, to generate image thumbnails on the first request,S3 LifeCycle Rules can delete content after N days

Using Amazon S3 asa Dynamic CacheAmazon

Cognito

To receive events from everywhere on the Internet

Webhooks are Callbacks for the Web

AWSLambda

AmazonAPI Gateway

InternetService

HTTP(S) GET or POST to https://domain/SOURCE/RANDOM-HOOK

Webhook

Other AWSServices

To generate eventsfor repositories

that don’t supportAWS Lambda natively

LogMonitor

AWSLambda

AWSLambda

AWSLambda

AmazonSNS

KinesisStream

LogFilesExternal

Application

Log Monitor

CloudWatchLogs or Metrics

AWSLambda

S3 object auto compress

S3 bucket per prefix statistics

DynamoDB provisioned throughput dynamic scaling

DynamoDB item support for geohash

Service Discovery

. . .

Extending Services with Your Own Functionalities

Serverless === Architecture Simplification

Serverless === Architecture Simplification

Media Sharing App

Client Application

Get Content Index

Get Content and Thumbnails

Upload Content with Metadata

Update Content Metadata

Get Content Metadata

Files (Multimedia)

Database

Build Thumbnails

Update Content Index

Extract and Update Metadata

Event: new or

updated file

Event: new or updated

content metadata

Functions

! User

ResourcesEvent-drivendesign

MediaSharing App

Client Application

Get Content Index (S3 API)


(S3 API)

Upload Contentwith Metadata

(S3 API)


(DynamoDB API)

Get Content Metadata (DynamoDB API)

S3 Bucket

DynamoDB Table

Build Thumbnails (Lambda function)


(Lambda function)


(Lambda function)

Event: new or

updated file


content metadata

! User

Choosingthe technology

MediaSharing App

Client Application



(S3 API)


(S3 API)


(DynamoDB API)

Get Content Metadata(DynamoDB API)

S3 Bucket

DynamoDB Table



(Lambda function)


(Lambda function)

Event: new or

updated file


content metadata

! User

Amazon Cognito

Addingimplementation

details

MediaSharing App

Client Application



(S3 API)


(S3 API)


(DynamoDB API)

Get Content Metadata(DynamoDB API)

S3 Bucket

DynamoDB Table



(Lambda function)


(Lambda function)

Event: new or

updated file


content metadata

! User

Amazon Cognito

From featureviewpoint…

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API

UpdateItem DynamoDB API

GetItem DynamoDB API

S3 Bucket

DynamoDB Table

buildThumbnails (Lambda function)

updateContentIndex (Lambda function)

extractAndUpdateMetadata (Lambda function)

Event: new or

updated file


content metadata

! User

Amazon Cognito

Amazon S3

Amazon DynamoDB

AWS Lambda…To the technology

viewpoint

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API



S3 Bucket

DynamoDB Table

buildThumbnails (Lambda function)


extractAndUpdateMetadata (Lambda function)

Event: new or

updated file


content metadata

! User

Amazon Cognito

Amazon S3

Amazon DynamoDB

AWS LambdaSome eventsare correlated

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API



S3 Bucket

DynamoDB Table

contentUpdated (Lambda function)

buildThumbnails extractAndUpdateMetadata


Event: new or

updated file

! User

Amazon Cognito

Amazon S3 AWS Lambda

Amazon DynamoDB


content metadata

Some functionscan be tied together

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API



S3 Bucket

DynamoDB Table




Event: new or

updated file

! User

Amazon Cognito


Amazon DynamoDB


content metadata

What if I want todelete content?

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API



S3 Bucket

DynamoDB Table



deleteMetadata


Event: new, updated,

or deleted file

! User

Amazon Cognito


Amazon DynamoDB

DELETE Object S3 API


content metadata

REST to the rescue,the events flow isalmost unchanged

MediaSharing App

Client Application

GET Object S3 API

PUT Object S3 API



S3 Bucket

DynamoDB Table



deleteMetadata


Event: new, updated,

or deleted file

! User

Amazon Cognito


Amazon DynamoDB

DELETE Object S3 API


content metadata

From 8 functions to 2,using 5 native API calls

MediaSharing App

Serverless Architectures are not just simplifying Ops

Devs can benefit from:

event-driven design

architectural patterns

integrating new products

architecture simplification

customization of the platform


Build Apps With Services,Not Servers


Thank you

@danilop danilop

serverless: an update from the field...api gateway cache api gateway cloudwatch lambda functions ec2...

Documents