spotinst 'aws cost optimization' webinar - jan 20th, 2016
TRANSCRIPT
![Page 1: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/1.jpg)
Saving Thousands By Running Mission Critical Applications on Spot
January 20th, 2016
© 2016 Spotinst, LTD. #spotinstmeetup
![Page 2: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/2.jpg)
Welcome!
To our 1st online
• Questions are always welcome• There are no bad questions• We’ll demo as much as we can• Things will break, be patient
![Page 3: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/3.jpg)
Amiram ShacharFounder & CEO / Spotinst
Gal AvivR&D Group Manager /
Inneractive
Shannon WilliamsCo-Founder & VP Marketing /
Rancher Labs
Shimon ToltsHead of Infrastructure /
ironSource
@AmiramShachar @galaviv @shimtolts @smw355
![Page 4: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/4.jpg)
Agenda• The Basics: Spotinst on AWS• Can I run my application on Spot?• Demo: Spotinst floating IPs, Beanstalk, CloudFormation• Use-case: Inneractive & Spotinst, Gal Aviv• Use-case: ironSource & Spotinst, Shimon Tolts• Using Rancher for Docker production workloads, Shannon• Demo: NEW! Spotinst & EMR autoscaling
![Page 5: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/5.jpg)
The ultimate platform for running and managing clusters in the cloud.
![Page 6: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/6.jpg)
Spot = Idle On Demand
Spot is a market where the price of compute changes based on supply and demand
The Basics
![Page 7: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/7.jpg)
Spot Strategy #1Significantly reduce your EC2 costs
cloud expenses graph of one of Spotinst’s customers. Before and after using Spotinst
![Page 8: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/8.jpg)
Budget EC2 Capacity Purchased
Spot Strategy #2Grow your compute capacity and throughput 10x for the same budget.
![Page 9: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/9.jpg)
Spot Barriers
SLA Capacity is not guaranteed.
Safe application drainingWhat happens if AWS pulls the plug?
![Page 10: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/10.jpg)
The Spotinst Way
![Page 11: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/11.jpg)
Jul August September Octber November DecemberRunning Hours of Spotinst Managed Cloud Servers
Spotinst traffic usageIncreased 100% MoM
1,000,000
![Page 12: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/12.jpg)
What can run on Spot?
Everything. except single point of failures.
![Page 13: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/13.jpg)
Spot Ready
Hadoop / Spark
ELB / HA-Proxy Docker / ECS Autoscaling
MicroservicesWeb Application
![Page 14: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/14.jpg)
Demo: Safe Draining
![Page 15: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/15.jpg)
Demo: Floating IPs, Beanstalk, CloudFormation
![Page 16: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/16.jpg)
© 2015 Rancher Labs, Inc.© 2015 Rancher Labs, Inc .
Rancher Labs OverviewShannon WilliamsJanuary 2016
![Page 17: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/17.jpg)
© 2015 Rancher Labs, Inc.
Public container services are becoming popular
Google Container Engine
![Page 18: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/18.jpg)
© 2015 Rancher Labs, Inc.
New private cloud: private container service
Private Container Service
Linux Linux Linux Linux Linux Linux
![Page 19: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/19.jpg)
© 2015 Rancher Labs, Inc.
How to build a private container service
Private Container Service
Linux Linux Linux Linux Linux Linux
Docker MachineSwarm, Kubernetes, MesosCompose, Kubernetes, Marathon, TOSCARancherLDAP, AD, GitHubStats, Health checks, Sysdig, Datadog, …Notary, Kubernetes, VaultVXLAN, IPSECiptablesHAProxy, iptables, ngnixCeph, EBS, SAN, ...Gluster, EFS, NAS, ...Swift, S3, ...etcd, consul, mongo, DynamoDB, ...
Resource MgmtSchedulingOrchestrationApp CatalogAccess ControlMonitoringSecurityOverlay networkFirewallLoad BalancerBlock StorageFile StorageObject StorageDistributed DB
![Page 20: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/20.jpg)
© 2015 Rancher Labs, Inc.
Open source container management platform for building a Private Container Service
A containerized Linux distribution for running Docker
![Page 21: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/21.jpg)
© 2015 Rancher Labs, Inc.
Rancher OverviewRancher Catalog
AD/LDAP
Alerts/Events
Environment 1 Environment N…Network Services Storage Services
Container Orchestration and SchedulingUser Mgmt Ops Mgmt
Environment 2
![Page 22: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/22.jpg)
© 2015 Rancher Labs, Inc.
• Leverage spot instances to reduce infrastructure costs • Identify upcoming changes and orchestrate reaction• Working on live migration for 2016
![Page 23: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/23.jpg)
G a l A v i vR & D G r o u p M a n a g e r
Spotinst Case Study
![Page 24: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/24.jpg)
What we do…
• Real time trading and optimizing campaigns over ad spaces
• Real time analytics• Machine learning and recommendations• Trading data and insights• Our tech stack: Java, Scala, AKKA, Spray, Kafka
Spark, Spark Streaming and Cassandra
![Page 25: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/25.jpg)
Scale and numbers…
• Billions of daily incoming requests
• Tens of Billions of daily transactions
• 150ms average response time
• Hundreds of servers in dozens of elastic clusters
• Extreme scaling (up/down)
![Page 26: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/26.jpg)
Scaling challenges
• Different cluster behavior (latency, CPU, load, QPS…)
• Tight back-pressure management (Scala/AKKA/Spray stack)
• Critical serving core (99.99% uptime)
• Service cost efficiency is crucial
![Page 27: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/27.jpg)
Spotinst integration
• Less than 1 day for initial setup
• Cluster by cluster partial migration
• Extreme costs reduce
• Cost vs. risk… Series10%
25%
50%
75%
100%
Reserved Spotinst OnDemand
![Page 28: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/28.jpg)
Nice to meet you!Shimon ToltsHead of infrastructure @ ironSource
![Page 29: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/29.jpg)
ironBeastData Flow Management Solution
SpotInst case study Shimon Toltshttp://www.ironsrc.com/ironbeast/
![Page 30: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/30.jpg)
PEOPLE REACHED EACH MONTH APPS INSTALLED EVERY MINUTEWITH THE IRONSOURCE PLATFORM
REGISTERED & ANALYZED DATA EVENTSEVERY MONTH
600M 4,200
100B+
70K+PARTNERED APPS
SEP. 2010ESTABLISHED
3.5B+INSTALLATIONS TO DATE
700TOTAL EMPLOYEES
400R&D EMPLOYEES
IRONSOURCE IN NUMBERS
TEL AVIV ISRAEL SAN FRANCISCO UNITED STATES NEW YORK UNITED STATES LONDON UNITED KINGDOM BEIJING CHINA
![Page 31: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/31.jpg)
ironBeast
Simplifying Big Data Flow Management
Learn more >
![Page 32: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/32.jpg)
● Our deployment - micro-services with Docker
● Implement it yourself?● 4 Availability Zones ● 5 Auto Scaling groups? (1 on demand)● c4.large, c3.large, r3.large, m4.large● 4x4=16 ASG + 1 On demand
SPOT INSTANCES
![Page 33: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/33.jpg)
![Page 34: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/34.jpg)
Spotinst
● One place to configure it all● Multi instance type support● Deep visibility into cost● High savings● Easy Risk/Reward mitigation (% of spot)
● Spot clean up mechanism
![Page 35: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/35.jpg)
Thank you
See you in our next webinar!
@Spotinst /spotinstance/spotinst
![Page 36: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/36.jpg)
NEW! EMR Task Nodes AutoScale
![Page 37: Spotinst 'AWS Cost Optimization' Webinar - Jan 20th, 2016](https://reader036.vdocuments.us/reader036/viewer/2022062904/5879ca121a28abb42a8b6f97/html5/thumbnails/37.jpg)
can run applications on Amazon’s and Google’s cloud for 1/10th of the regular price
It is a fact