google cloud - scale with a smile (dec 2014)

PerformanceScale (with a smile)Value

Google Cloud Platform

#CodeMotion TLV 2014

+Ido Green

@greenido

ido-green.appspot.com

#CodeMotion TLV 2014

For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.

Images by Connie Zhou

Cloud Platform is built on the same infrastructure that powers Google.

Images by Connie Zhou

Images by Connie Zhou

Google’s Platform“[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels.

This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.”

- Wired

Google's Network Spans the Globe

The Pace of Software Innovation

Spanner/F1DremelMapReduce

Big Table Colossus

2012 20132002 2004 2006 2008 2010

GFS Omega

Cloud Storage

BigQuery

Cloud Datastore

#CodeMotion TLV 2014

Yes, We Can Power that

Mobile Gaming Storage

Big Data Highly Scalable Apps Digital Marketing

#CodeMotion TLV 2014

BigQuery

Compute Storage

Cloud Storage

App Services

Compute Engine

App Engine

Queues

Caching

Cloud Endpoints

Persistent Disk

Cloud Datastore

Cloud SQL

Google Cloud Platform

CodeMotion TLV 2014

BigQuery

Compute Storage

Cloud Storage

App Services

Compute Engine

App Engine

Queues

Caching

Cloud Endpoints

Persistent Disk

Cloud Datastore

Cloud SQL

Google Cloud Platform

#CodeMotion TLV 2014

Exploring the Cloud

IaaSInfrastructure-as-a-Service

PaaSPlatform-as-a-Service

SaaSSoftware-as-a-Service

Google Cloud Platform

build and deploy vm images

● Curated runtimes● Rich services● Auto-everything● … just add code

● Managed collections● Declarative + Dynamic

Compute as a Continuum

PlatformClusterVM

More Agility

More flexibility

build and deploy clusters build and deploy apps

● Basic atom● Run anything

Virtual Machines On GCEBuild and Deploy VMs

● Beta! Local SSD

● Ubuntu VM Image

● Regions

○ Asia

○ Additional zones in US, Europe

● Transparent maintenance

● 16-core VMs

● Lower prices (again)

Recent Updates Google Compute Engine

New! Bitnami Images

google.bitnami.com

Deploy your favorite open source server software

More than 90 apps or infrastructure stacks

Cloud Platform

MapRBreaks MinuteSort Record

• 1.5TB in 60 seconds

• 8,412 cores

• Google Compute Engine

● MapR broke the MinuteSort world record using

Compute Engine for only $1200.

● The previous record was set using custom

hardware costing hundreds of thousands of

dollars.

● GCE In Action

● Demo Code: github.com/GoogleCloudPlatform/compute-appengine-demo-suite-python

● NodeJS & Docker○ github.

com/GoogleCloudPlatform/runtime-nodejs-docker-image

● developers.google.com/compute/docs/samples-and-videos

Google Compute Engine Demo

Google App Engine

Python, Java, PHP, Go

Simple to Scale- AutoScale

Trivial to manage- Fully managed- No patches- 24x7 operation by Google SREs

Easy to develop- Free to start- Local dev environment- Service abstractions

App Engine

Cloud Platform

App Engine

• Fully Managed Platform

• Popular Programming Language Support

• Flexible and Scalable Application Storage

• Auto-scaling

• Versioning and Traffic Splitting

• Local Developer Tools

• Third-party Frameworks and Extensions:

webapp2, Django, Flask, Tornado, Sprint etc’

Cloud Platform

- Chris Chew, Udacity

"I'd rather be democratizing education than scaling memcached."

App Engine Managed VMsBuild and Deploy VMs

Managed VMsApp Engine

● App Engine productivity - on VMs

○ More flexible, powerful

● Bring your own

○ Dependencies○ Runtime (Docker container)

● What’s new?

○ Load Balancing○ Autoscaling○ Cloud SDK Integration

Beta! App Engine Managed VMs

module: sudoku

runtime: python27

api_version: 1

vm: true

vm_settings:

machine_type: n1-standard-1

apt_get_install: python-opencv

automatic_scaling:

min_num_instances: 2

max_num_instances: 20

...

app.yaml

Custom Runtimes and Autoscaling

● Define your own Runtime environments on Managed VMs

● You provide:○ A Dockerfile that defines a

Base Docker Image○ An app.yaml config file

● Optionally○ Respond to LifeCycle events

and Health Checks

module: webrtc

runtime: custom

api_version: 1

vm: true

...

app.yaml

FROM mycompany/custom-nodejs-runtime

Dockerfile

docker build

using google/docker-registry

container

GoogleCompute Engine

VM

your laptop

docker run

gcloud app deploystartupdate

using google/docker-registry

container

privateGoogle Cloud

Storagebucket

Google App Engine

Your Docker image

Your Docker image

docker pushdocker pull

Managed VMs Runtime Environment

container

$ gcloud app deploy

Cloud Platform

Storage

Cloud Storage

Cloud SQL

Cloud Datastore

App Services

BigQuery

Cloud Endpoints

Caching

Queues

Compute

Compute Engine

App Engine

Storing what you want, however you want

• Versioning

• Static Sites

• Resumable Transfers

• Object Change Notifications

Cloud Datastore

Cloud Datastore• Auto-scale

• Schemaless Access

• SQL-like Capabilities

• Authentication That Just Works

• Fast and Easy Provisioning

• RESTful Endpoints

• ACID Transactions

• Local Development Tools

• Built-in Redundancy

Cloud SQL

• Fully managed

• Ease of Use

• Highly Reliable

• Flexible Charging

• Security, Availability, Durability

• EU and US Data Centers

• Easy Migration & Data Portability

• Control

Cloud Platform

Storage

Cloud Storage

Cloud SQL

Cloud Datastore

App Services

BigQuery

Cloud Endpoints

Caching

Queues

Compute

Compute Engine

App Engine

Building robust, intelligent systems

BigQuery

• Fully Managed Big Data Analytics Service

• Fast

• Scalable

• Flexible and Familiar

• Security and Reliability

The basics and BigQuery with Apps Script

Cloud Platform

DEMO: Insights On Github

Who’s making amazing things withGoogle Cloud Platform?

Cloud Platform

Snapchat

Delivering 350+ million snaps a day

Cloud Platform

Serving 18TB a day with 80 million

users from Google Cloud Storage,

Cloud Datastore, and App Engine

SongPop

Cloud Platform

Eurovison

● Handled 50,000 requests/second

with 90% served in <24ms

● With Scalr and Compute Engine

Powering the futurewith unprecedented features

● cloud.google.com

● googlecloudplatform.blogspot.com

● plus.google.com/+GoogleCloudPlatform

● twitter.com/GoogleCloud

Get questions answered on StackOverflow !

cloud.google.com

Images by Connie Zhou

Thank you!

● ido-green.appspot.com

● +GreenIdo

● @greenido

#CodeMotion TLV 2014