1© Copyright 2016 EMC Corporation. All rights reserved. 1© Copyright 2016 EMC Corporation. All rights reserved.
RESILIENCY AND AVAILABILITY OF A CLOUD NATIVE INFRASTRUCTUREJONAS ROSLAND, EMC {code}DEVELOPER ADVOCATE & COMMUNITY MANAGER
4© Copyright 2016 EMC Corporation. All rights reserved.
• High Availability solutions• Mostly Primary-Secondary, Master-Slave• Provides redundancy
FIRST, SOME HISTORY
5© Copyright 2016 EMC Corporation. All rights reserved.
• Resiliency is a quality in objects to hold or recover their shape• Example: If you bend a spoon and it bends right back
— that's resiliency
SO WHAT IS RESILIENCY?
6© Copyright 2016 EMC Corporation. All rights reserved.
• Create services that withstand pressure• Foster a modern mindset in operations• Treat failures as normal occurrences, not fires
HOW DOES SPOON BENDING APPLY TO IT?
7© Copyright 2016 EMC Corporation. All rights reserved.
• Service failures are treated as non-critical issues• Applications and services self-heal• The infrastructure supports this with modern tools
FAILURE HANDLING
8© Copyright 2016 EMC Corporation. All rights reserved.
• Focused but not necessarily fully dedicated• Not limited to a single master-slave relationship
• Example 1: 20 nodes with resources to run services such as Hadoop, web servers and databases• Example 2: VMware clusters
MODERN INFRASTRUCTURE
9© Copyright 2016 EMC Corporation. All rights reserved.
• Not just server-side clustering tools• Many layers• Schedulers, service discovery, logging, monitoring
and much more
MANAGING THIS INFRASTRUCTURE
10© Copyright 2016 EMC Corporation. All rights reserved.
• Collection of compute resources• Spread out horizontally• Brings scale to your
deployments– Docker Swarm– Mesos– Kubernetes– Cloud Foundry
RESOURCE MANAGERS AND SCHEDULERS
11© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE
12© Copyright 2016 EMC Corporation. All rights reserved.
• Enables apps and infrato automatically findparts of each other– Consul– etcd– SkyDNS– Zookeeper
SERVICE DISCOVERY
13© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE Service Discovery
Java App
2.3.4.5:8080 Where isJava App?2.3.4.5:8080
14© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE Service Discovery
Java A
pp
3.4.5.6:9090Where is
Java App?3.4.5.6:9090
15© Copyright 2016 EMC Corporation. All rights reserved.
• All logs in one place
• Everything searchable
LOGGING
16© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE
17© Copyright 2016 EMC Corporation. All rights reserved.
• Sensu• Datadog• Prometheus• New Relic• Ruxit
MONITORING AND ANALYTICS
18© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE
19© Copyright 2016 EMC Corporation. All rights reserved.
• Everything is managed through smart tools• The tools have integrations to understand hardware• By changing the processes you’re more prepared• Being more prepared is crucial to deal with failures
when they happen
And they will happen
LOOK OF PHYSICAL INFRASTRUCTURE
20© Copyright 2016 EMC Corporation. All rights reserved.
But what about mysuper special app?
21© Copyright 2016 EMC Corporation. All rights reserved.
Applications haveto store data, right?
22© Copyright 2016 EMC Corporation. All rights reserved.
• Storing data (state) is a critical component of any application• Where they store this state defines their class
– Connected database– In memory– Local disk
APPLICATION STATE DIFFERENCES
23© Copyright 2016 EMC Corporation. All rights reserved.
• Store no critical data locally• Can be scaled as needed• Recovers quickly
STATELESS APPLICATIONS
24© Copyright 2016 EMC Corporation. All rights reserved.
• Services that store state• Have usually been treated as HA apps• Can be scale-out or scale-up
STATEFUL SERVICES
25© Copyright 2016 EMC Corporation. All rights reserved. 25© Copyright 2016 EMC Corporation. All rights reserved.
APPLICATIONS BUILT FROM SERVICESFront End or Non-Persistent
Data Services (Persistent)
Scal
e-Up
Scale-Out
CassandraPostgresRedis CouchDB
Elastic SearchHadoop
MariaDB
Mysql
Nginx
HAProxy
MongoDB
RabbitMQTomcat
Memcached
ScaleIO ECS
ApacheRails
Language Specific HTTP
26© Copyright 2016 EMC Corporation. All rights reserved.
Demo of resiliency
27© Copyright 2016 EMC Corporation. All rights reserved.
• Several applications, stateful and stateless, are running and working together• Cascading server failures occurs• Applications are restarted and automatically heal
themselves• The servers are back online and automatically join
the cluster of resources again
DEMO OF FAILURE HAPPENING
28© Copyright 2016 EMC Corporation. All rights reserved.
• Being prepared is crucial, surprises shouldn’t happen• Use smart tools to deal with issue quickly• Leverage smart infrastructure that allows your apps
to self-heal• Manage your datacenter as an entity, not silos
SUMMARY
29© Copyright 2016 EMC Corporation. All rights reserved.
Before opening up for questions
30© Copyright 2016 EMC Corporation. All rights reserved.
• Hands-on lab with Docker, Mesos and REX-Ray• Free stickers at our booth• Join our community at community.emccode.com• See all our projects at emccode.com• And follow us on Twitter @EMCcode
CONTINUE THE DISCUSSION
31© Copyright 2016 EMC Corporation. All rights reserved.
@EMCcode@jonasrosland
emccode.comcommunity.emccode.com
Come visit us at Booth #1044 or in the vLab
Questions?
33© Copyright 2016 EMC Corporation. All rights reserved. 33© Copyright 2016 EMC Corporation. All rights reserved.