ibm bluemix openwhisk: cloud foundry summit 2016, frankfurt, germany: the future of cloud...

Serverless and Event-driven Applications with Cloud Foundry and OpenWhisk

Andrei Yurkevich (@yurkvch)Chief Technology Officer

Andreas Nauerz (@AndreasNauerz)Technical Product Manager

@altoros

@yurkvch

WHAT WE DOAltoros brings “software assembly lines” into organizationsthrough integration of solutions offered by the Cloud Foundry ecosystem.

TRAINING:

FOR OPERATORS FOR DEVELOPERS

DEVELOPER ADOPTION

CONSULTING

PROOF OF CONCEPT

& IMPLEMENTATION

APP DEVELOPMENT & MICROSERVICES

2

POPULARPOPULAR

Delivered by partners:

Delivered by Altoros:

@altoros

@yurkvch

WHO WE AREAltoros offices Delivery partner in APAC

3

Minsk, BY

Oslo, NO

Sunnyvale, CA

(HQ)Chicopee,

MA

London, UK

Espoo, FI

Buenos Aires, ARSanta Fe,

AR

Tokyo, JP

Silkeborg, DK

Zurich, CH

Taby, SE

4

We will tell you about…

● Why we need event-driven infrastructure

5



● Requirements for event-driven infrastructure

6




● Introducing OpenWhisk

7





● OpenWhisk and CloudFoundry

8





● OpenWhisk and CloudFoundry

● Demo

9

Welcome to Industrial internet!

10

Devices can be...

11

How would you implement it?

12

OK, let’s move step by step

13

And if you want it to be HA?

14

What about another device?

15

Let’s be smart!

16

An unexpected spike!

17

Scaling out!

18

And traffic goes down...

19

An excessive compute?

20

Or maybe those ones?

21

And in the meantime...

22

And further down...

23

And...

24

One process, one container

25

One process, one container

26

But if we don’t scale fast...

How much does it cost?

27

Ideal case

28

Compute follows traffic

29

Compute follows traffic

30

So what are the requirements?

● Invoke and scale as fast as possible● Terminate after completion

31


● Invoke and scale as fast as possible● Terminate after completion● Charge per compute used

32


● Invoke and scale as fast as possible● Terminate after completion● Charge per compute used● Guaranteed message delivery● Load balancing

33


● Invoke and scale as fast as possible● Terminate after completion● Charge per compute used● Guaranteed message delivery● Load balancing● High availability● Self-healing

34



● Support of multiple technologies

● Have possibility to launch other microservices

● Write and read data from multiple data sources

35



● Support of multiple technologies

● Have possibility to launch other microservices

● Write and read data from multiple data sources

● Abstract developers from the infrastructure

Yorktown, NY

OpenWhisk in a nutshell

Raleigh, NCAustin, TX

Boeblingen, Germany

Serverless computing in general and OpenWhisk in particular is regarded an important effort 31

37


„Event-action platform to execute code in response to events“

* whisk (v): to move nimbly and quickly (source: merriam-webster.com)

38


„Event-action platform to execute code in response to events“

Delivered as open source & managed service on IBM Bluemix

* whisk (v): to move nimbly and quickly (source: merriam-webster.com)

39


Serverless deployment & operations model

40



Optimal utilization & granular pricing

41




Scales on a per-request basis

42




Flexible programming model

Supports higher-level programming constructs (e.g. sequencing)


Polyglot support

43





Open (Apache 2) & open ecosystem


Open interface for event providers


Polyglot support

Leverages Docker, Kafka, Consul, …

44





Open (Apache 2) & open ecosystem


Open interface for event providers


Polyglot support

Implemented in Scala

Leverages Docker, Kafka, Consul, …


Swift

Application

Container VMCF

2

Polling

1b

Request

1a

Traditional model

• Continous polling due to missing event programming model

• Charges even when idling due to poor utilization

Process & idle


Swift

Application

Container VMCF

2

Polling

1b

Request

1a

Traditional model



• Worry about scaling- When to scale? (mem-, cpu-, response time-driven)- How fast to scale?

Process & idle


Swift

Application

Container VMCF

2

Polling

1b

Request

1a

Traditional model



• Worry about scaling- When to scale? (mem-, cpu-, response time-driven)- How fast to scale?

• Worry about resiliency- At least 2 processes for HA (driving cost)- Deployment in multiple regions (driving cost)- Keep them running & healthy

Process & idle


OpenWhisk

• Introduces event programming model• Charges only for what is used due to optimal

utilization Pool of actions

Swift DockerJS

Trigger

1

Running action

Running action

Running action

3

Deploy action within millisecs,run it, free up resources

OpenWhisk Engine

2


OpenWhisk


utilization

• Scales inherently- One process per request

Pool of actions

Swift DockerJS

Trigger

1

Running action

Running action

Running action

3


OpenWhisk Engine

2


OpenWhisk


utilization

• Scales inherently- One process per request

• No cost overhead for resiliency- No long running process for HA

Pool of actions

Swift DockerJS

Trigger

1

Running action

Running action

Running action

3


OpenWhisk Engine

2


} 1

Event Providers

OpenWhisk

Cloudant

Push Notifcations

…

…

…

Data event occurs, e.g.-Commit on a Git Repository-CRUD operation on Cloudant-….

Trigger execution of associated OpenWhisk action

2

…JS Swift Docker …


OpenWhisk

JS Swift Docker …

Incoming HTTP request, e.g.HTTP GET mynewcoolapp.com/customers

1 2 Invoke associated OpenWhisk action „getCustomers“

Browser

Mobile App

Web App

Variety of languages


• Services define the events they emit as triggers, and developers associate the actions to handle the events via rules

• The developer only needs to care about implementing the desired application logic - the system handles the rest

T R A


Trigger: „A class of events that can happen“T


A Actions: „An event-handler, i.e. code that runs in response to an event“


A

AA:= A1

+ A2+ A3

AB:= A2

+ A1+ A3

AC:= A3

+ A1+ A2

Actions: Can be chained to create sequences to increase flexibility and foster reuse


R

R := T A

Rules: „An association of a trigger and an action“


myActionmyFeedT

A

Packages: „A shared collection of triggers and actions“P

A forecast

OpenSource YoursThird

Party

translatelanguageIdtextToSpeechA

AA

databaseCreatedocumentRead...changesT

AAA

Push Notifications

sendMessagewebhookT

A

webhookT

postA

WebsocketsendA


You want to try OpenWhisk on your own?



• Want to try out our IBM Bluemix OpenWhisk offering?Sign-up today at: https://new-console.ng.bluemix.net/openwhisk/



• Want to try out our IBM Bluemix OpenWhisk offering?Sign-up today at: https://new-console.ng.bluemix.net/openwhisk/

• Want to try out our open-source OpenWhisk offering?Visit: https://developer.ibm.com/openwhisk/

62

Demo time!

http://bit.ly/1Uw6OP3

63

I will show you...

64

How did it work?

https://developer.ibm.com/openwhisk/2016/04/01/ibm-bluemix-openwhisk-whats-under-the-hood/

65

Another prospective

@yurkvch @altoros 6

6

Cloud Foundry and OpenWhisk

67

I can’t use OpenWhisk on Bluemix because

Vendor lock-in

68


Vendor lock-inAll my data is (in local datacenter)

69



We implement a hybrid strategy

70




We don’t use Bluemix at...

71





I need to have the compute device on the network edge

72


Vendor lock-inAll my data is (in a local data center)



I need to have the compute device on the network edge

Security!

73

https://github.com/openwhisk

https://github.com/openwhisk/openwhisk

altoros.comblog.altoros.com

developer.ibm.com/openwhisk

74

@yurkvch@altoros

Questions? @AndreasNauerz@OpenWhisk

http://www.altoros.com/

altoros.comblog.altoros.com

developer.ibm.com/openwhisk

75

@yurkvch@altoros

Thank you! @AndreasNauerz@OpenWhisk

http://www.altoros.com/

ibm bluemix openwhisk: cloud foundry summit 2016, frankfurt, germany: the future of cloud...

Software