spring cloud into production

SPRING CLOUD INTO PRODUCTION

TODD MILLER


ABOUT MEAtlanta, GA

Inc 5000 fastest growing companies 5 years in a row

Forbes 25 Best Small Businesses 2016

Father of four

[email protected] @ziftytodd

Microservices are great… until you realize all the other 💩 it takes to run them.

Todd Miller


SPRING INTO PRODUCTION

MICROSERVICE “TAX”

▸ Configuration Management

▸ Service Discovery (and registration)

▸ More faults to handle (and more gracefully)

▸ Authentication & Authorization

▸ and so on…


WHAT IS SPRING CLOUD?

▸ Config management

▸ Service discovery

▸ Circuit breakers

▸ Intelligent routing

▸ Micro-proxy

▸ Control bus

▸ One-time tokens

▸ Global locks

▸ Distributed sessions …. and more!


CONFIGURATION - SPRING CLOUD CONFIG

▸ Separate server service

▸ Keep config in a repository

▸ YAML or Properties files

▸ Supports multiple services and profiles

▸ Super simple client

▸ One config line

▸ One dependency


SERVICE DISCOVERY - EUREKA

▸ Separate server service

▸ Service registry

▸ Clients register and discover

▸ Some fault tolerance

▸ Add Ribbon for intelligent routing


CIRCUIT BREAKERS - HYSTRIX

▸ Part of your service’s code

▸ Circuit breaker

▸ Failure isolation

▸ Graceful degradation

▸ Built-in monitoring

▸ Use with Turbine to aggregate


EC2 CONTAINER SERVICE (ECS)

▸ Manages containers & cluster

▸ Define tasks

▸ Compose tasks into services

▸ Load balancing

▸ Auto-scaling

▸ AWS’s Docker registry (ECR)


CLOUD CONFIG INTO PRODUCTION

▸ Which comes first? Eureka or Config?

▸ How do you find the Config Server?

▸ Use an ELB to point to config server instances


Gr8ConfigApplication.groovy

bootstrap.yml

Dockerfile


IT RUNS!

▸ Access via ELB’s endpoint URL

▸ But who wants to remember a URL like this?

▸ Plus, it’s not very portable

▸ Enter AWS Route 53 and private DNS


IT RUNS BETTER!

▸ Any service in our VPC can access via

http://config.gr8conf.vpc:8888/

▸ Private hosted zones do not work from outside VPC access

▸ Use public DNS records if external access is needed


EUREKA INTO PRODUCTION

▸ How do you find a server?

▸ How do servers find each other?

▸ Route53 and DNS to the rescue again


Gr8EurekaApplication.groovy


bootstrap.yml


eureka-server.yml


ROUTE 53 FOR EUREKA

▸ TXT record per region to point to AZ in that region txt.us-east-1.gr8conf.vpc ->us-east-1d.gr8conf.vpc

us-east-1e.gr8conf.vpc

▸ TXT record per AZ in region txt.us-east-1d.gr8conf.vpc ->

ec2-##-##-##-##.compute-1.amazonaws.com

ec2-##-##-##-##.compute-1.amazonaws.com


A FEW TRICKS

▸ List of EC2 instances must use the expanded EIP hostname

▸ Separated by spaces

▸ Space at start, and space at end

▸ Failure results in Eureka servers using wrong hostname and not recognizing each other properly


HOW DO OUR SERVICES USE THIS?

▸ Point to config server ELB

▸ Store Eureka config details for clients in config server

▸ EurekaInstanceConfigBean has to happen on services too


Gr8ServiceApplication.groovy


Gr8Controller.groovy


bootstrap.yml


gr8service.yml


DEPLOY TO PRODUCTION

▸ Same as we’ve seen

▸ Push Docker image to ECR

▸ Create Task Definition

▸ Create Service

▸ Public facing? Use an ELB to get a reliable URL


HYSTRIX MONITORING

▸ Use Hystrix Dashboard


http://techblog.netflix.com/2012/12/hystrix-dashboard-and-turbine.html


HYSTRIX MONITORING FOR THEM ALL

▸ Start a Turbine server

▸ Finds services to get Hystrix streams via Eureka

▸ Need AMPQ broker


http://www.programering.com/a/MDN3gzNwATE.html


THANK YOU

▸ https://github.com/ziftytodd

▸ [email protected]

▸ @ziftytodd

▸ www.zifty.com

http://www.zifty.com

spring cloud into production

Technology