google cloud - scale with a smile (dec 2014)
TRANSCRIPT
PerformanceScale (with a smile)Value
Google Cloud Platform
#CodeMotion TLV 2014
+Ido Green
@greenido
ido-green.appspot.com
#CodeMotion TLV 2014
For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.
Images by Connie Zhou
Cloud Platform is built on the same infrastructure that powers Google.
Images by Connie Zhou
Images by Connie Zhou
Google’s Platform“[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels.
This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.”
- Wired
Google's Network Spans the Globe
The Pace of Software Innovation
Spanner/F1DremelMapReduce
Big Table Colossus
2012 20132002 2004 2006 2008 2010
GFS Omega
Cloud Storage
BigQuery
Cloud Datastore
#CodeMotion TLV 2014
Yes, We Can Power that
Mobile Gaming Storage
Big Data Highly Scalable Apps Digital Marketing
#CodeMotion TLV 2014
BigQuery
Compute Storage
Cloud Storage
App Services
Compute Engine
App Engine
Queues
Caching
Cloud Endpoints
Persistent Disk
Cloud Datastore
Cloud SQL
Google Cloud Platform
CodeMotion TLV 2014
BigQuery
Compute Storage
Cloud Storage
App Services
Compute Engine
App Engine
Queues
Caching
Cloud Endpoints
Persistent Disk
Cloud Datastore
Cloud SQL
Google Cloud Platform
#CodeMotion TLV 2014
Exploring the Cloud
IaaSInfrastructure-as-a-Service
PaaSPlatform-as-a-Service
SaaSSoftware-as-a-Service
Google Cloud Platform
build and deploy vm images
● Curated runtimes● Rich services● Auto-everything● … just add code
● Managed collections● Declarative + Dynamic
Compute as a Continuum
PlatformClusterVM
More Agility
More flexibility
build and deploy clusters build and deploy apps
● Basic atom● Run anything
Virtual Machines On GCEBuild and Deploy VMs
● Beta! Local SSD
● Ubuntu VM Image
● Regions
○ Asia
○ Additional zones in US, Europe
● Transparent maintenance
● 16-core VMs
● Lower prices (again)
Recent Updates Google Compute Engine
New! Bitnami Images
google.bitnami.com
Deploy your favorite open source server software
More than 90 apps or infrastructure stacks
Cloud Platform
MapRBreaks MinuteSort Record
• 1.5TB in 60 seconds
• 8,412 cores
• Google Compute Engine
● MapR broke the MinuteSort world record using
Compute Engine for only $1200.
● The previous record was set using custom
hardware costing hundreds of thousands of
dollars.
● GCE In Action
● Demo Code: github.com/GoogleCloudPlatform/compute-appengine-demo-suite-python
● NodeJS & Docker○ github.
com/GoogleCloudPlatform/runtime-nodejs-docker-image
● developers.google.com/compute/docs/samples-and-videos
Google Compute Engine Demo
Google App Engine
Python, Java, PHP, Go
Simple to Scale- AutoScale
Trivial to manage- Fully managed- No patches- 24x7 operation by Google SREs
Easy to develop- Free to start- Local dev environment- Service abstractions
App Engine
Cloud Platform
App Engine
• Fully Managed Platform
• Popular Programming Language Support
• Flexible and Scalable Application Storage
• Auto-scaling
• Versioning and Traffic Splitting
• Local Developer Tools
• Third-party Frameworks and Extensions:
webapp2, Django, Flask, Tornado, Sprint etc’
Cloud Platform
- Chris Chew, Udacity
"I'd rather be democratizing education than scaling memcached."
App Engine Managed VMsBuild and Deploy VMs
Managed VMsApp Engine
● App Engine productivity - on VMs
○ More flexible, powerful
● Bring your own
○ Dependencies○ Runtime (Docker container)
● What’s new?
○ Load Balancing○ Autoscaling○ Cloud SDK Integration
Beta! App Engine Managed VMs
module: sudoku
runtime: python27
api_version: 1
vm: true
vm_settings:
machine_type: n1-standard-1
apt_get_install: python-opencv
automatic_scaling:
min_num_instances: 2
max_num_instances: 20
...
app.yaml
Custom Runtimes and Autoscaling
● Define your own Runtime environments on Managed VMs
● You provide:○ A Dockerfile that defines a
Base Docker Image○ An app.yaml config file
● Optionally○ Respond to LifeCycle events
and Health Checks
module: webrtc
runtime: custom
api_version: 1
vm: true
...
app.yaml
FROM mycompany/custom-nodejs-runtime
Dockerfile
docker build
using google/docker-registry
container
GoogleCompute Engine
VM
your laptop
docker run
gcloud app deploystartupdate
using google/docker-registry
container
privateGoogle Cloud
Storagebucket
Google App Engine
Your Docker image
Your Docker image
docker pushdocker pull
Managed VMs Runtime Environment
container
$ gcloud app deploy
Cloud Platform
Storage
Cloud Storage
Cloud SQL
Cloud Datastore
App Services
BigQuery
Cloud Endpoints
Caching
Queues
Compute
Compute Engine
App Engine
Storing what you want, however you want
• Versioning
• Static Sites
• Resumable Transfers
• Object Change Notifications
Cloud Datastore
Cloud Datastore• Auto-scale
• Schemaless Access
• SQL-like Capabilities
• Authentication That Just Works
• Fast and Easy Provisioning
• RESTful Endpoints
• ACID Transactions
• Local Development Tools
• Built-in Redundancy
Cloud SQL
• Fully managed
• Ease of Use
• Highly Reliable
• Flexible Charging
• Security, Availability, Durability
• EU and US Data Centers
• Easy Migration & Data Portability
• Control
Cloud Platform
Storage
Cloud Storage
Cloud SQL
Cloud Datastore
App Services
BigQuery
Cloud Endpoints
Caching
Queues
Compute
Compute Engine
App Engine
Building robust, intelligent systems
BigQuery
• Fully Managed Big Data Analytics Service
• Fast
• Scalable
• Flexible and Familiar
• Security and Reliability
The basics and BigQuery with Apps Script
Cloud Platform
DEMO: Insights On Github
Who’s making amazing things withGoogle Cloud Platform?
Cloud Platform
Snapchat
Delivering 350+ million snaps a day
Cloud Platform
Serving 18TB a day with 80 million
users from Google Cloud Storage,
Cloud Datastore, and App Engine
SongPop
Cloud Platform
Eurovison
● Handled 50,000 requests/second
with 90% served in <24ms
● With Scalr and Compute Engine
Powering the futurewith unprecedented features
● cloud.google.com
● googlecloudplatform.blogspot.com
● plus.google.com/+GoogleCloudPlatform
● twitter.com/GoogleCloud
Get questions answered on StackOverflow !
cloud.google.com
Images by Connie Zhou
Thank you!
● ido-green.appspot.com
● +GreenIdo
● @greenido
#CodeMotion TLV 2014