google cloud - scale with a smile (dec 2014)

41
Performance Scale (with a smile) Value Google Cloud Platform #CodeMotion TLV 2014

Upload: ido-green

Post on 12-Jul-2015

886 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Google Cloud - Scale With A Smile (Dec 2014)

PerformanceScale (with a smile)Value

Google Cloud Platform

#CodeMotion TLV 2014

Page 3: Google Cloud - Scale With A Smile (Dec 2014)

For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.

Images by Connie Zhou

Page 4: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform is built on the same infrastructure that powers Google.

Images by Connie Zhou

Page 5: Google Cloud - Scale With A Smile (Dec 2014)

Images by Connie Zhou

Google’s Platform“[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels.

This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.”

- Wired

Page 6: Google Cloud - Scale With A Smile (Dec 2014)

Google's Network Spans the Globe

Page 8: Google Cloud - Scale With A Smile (Dec 2014)

#CodeMotion TLV 2014

Yes, We Can Power that

Mobile Gaming Storage

Big Data Highly Scalable Apps Digital Marketing

Page 9: Google Cloud - Scale With A Smile (Dec 2014)

#CodeMotion TLV 2014

BigQuery

Compute Storage

Cloud Storage

App Services

Compute Engine

App Engine

Queues

Caching

Cloud Endpoints

Persistent Disk

Cloud Datastore

Cloud SQL

Google Cloud Platform

Page 10: Google Cloud - Scale With A Smile (Dec 2014)

CodeMotion TLV 2014

BigQuery

Compute Storage

Cloud Storage

App Services

Compute Engine

App Engine

Queues

Caching

Cloud Endpoints

Persistent Disk

Cloud Datastore

Cloud SQL

Google Cloud Platform

Page 11: Google Cloud - Scale With A Smile (Dec 2014)

#CodeMotion TLV 2014

Exploring the Cloud

IaaSInfrastructure-as-a-Service

PaaSPlatform-as-a-Service

SaaSSoftware-as-a-Service

Google Cloud Platform

Page 12: Google Cloud - Scale With A Smile (Dec 2014)

build and deploy vm images

● Curated runtimes● Rich services● Auto-everything● … just add code

● Managed collections● Declarative + Dynamic

Compute as a Continuum

PlatformClusterVM

More Agility

More flexibility

build and deploy clusters build and deploy apps

● Basic atom● Run anything

Page 13: Google Cloud - Scale With A Smile (Dec 2014)

Virtual Machines On GCEBuild and Deploy VMs

Page 14: Google Cloud - Scale With A Smile (Dec 2014)

● Beta! Local SSD

● Ubuntu VM Image

● Regions

○ Asia

○ Additional zones in US, Europe

● Transparent maintenance

● 16-core VMs

● Lower prices (again)

Recent Updates Google Compute Engine

Page 15: Google Cloud - Scale With A Smile (Dec 2014)

New! Bitnami Images

google.bitnami.com

Deploy your favorite open source server software

More than 90 apps or infrastructure stacks

Page 16: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

MapRBreaks MinuteSort Record

• 1.5TB in 60 seconds

• 8,412 cores

• Google Compute Engine

● MapR broke the MinuteSort world record using

Compute Engine for only $1200.

● The previous record was set using custom

hardware costing hundreds of thousands of

dollars.

Page 18: Google Cloud - Scale With A Smile (Dec 2014)

Google App Engine

Python, Java, PHP, Go

Page 19: Google Cloud - Scale With A Smile (Dec 2014)

Simple to Scale- AutoScale

Trivial to manage- Fully managed- No patches- 24x7 operation by Google SREs

Easy to develop- Free to start- Local dev environment- Service abstractions

App Engine

Page 20: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

App Engine

• Fully Managed Platform

• Popular Programming Language Support

• Flexible and Scalable Application Storage

• Auto-scaling

• Versioning and Traffic Splitting

• Local Developer Tools

• Third-party Frameworks and Extensions:

webapp2, Django, Flask, Tornado, Sprint etc’

Page 21: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

- Chris Chew, Udacity

"I'd rather be democratizing education than scaling memcached."

Page 22: Google Cloud - Scale With A Smile (Dec 2014)

App Engine Managed VMsBuild and Deploy VMs

Page 23: Google Cloud - Scale With A Smile (Dec 2014)

Managed VMsApp Engine

Page 24: Google Cloud - Scale With A Smile (Dec 2014)

● App Engine productivity - on VMs

○ More flexible, powerful

● Bring your own

○ Dependencies○ Runtime (Docker container)

● What’s new?

○ Load Balancing○ Autoscaling○ Cloud SDK Integration

Beta! App Engine Managed VMs

module: sudoku

runtime: python27

api_version: 1

vm: true

vm_settings:

machine_type: n1-standard-1

apt_get_install: python-opencv

automatic_scaling:

min_num_instances: 2

max_num_instances: 20

...

app.yaml

Page 25: Google Cloud - Scale With A Smile (Dec 2014)

Custom Runtimes and Autoscaling

● Define your own Runtime environments on Managed VMs

● You provide:○ A Dockerfile that defines a

Base Docker Image○ An app.yaml config file

● Optionally○ Respond to LifeCycle events

and Health Checks

module: webrtc

runtime: custom

api_version: 1

vm: true

...

app.yaml

FROM mycompany/custom-nodejs-runtime

Dockerfile

Page 26: Google Cloud - Scale With A Smile (Dec 2014)

docker build

using google/docker-registry

container

GoogleCompute Engine

VM

your laptop

docker run

gcloud app deploystartupdate

using google/docker-registry

container

privateGoogle Cloud

Storagebucket

Google App Engine

Your Docker image

Your Docker image

docker pushdocker pull

Managed VMs Runtime Environment

container

$ gcloud app deploy

Page 27: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

Storage

Cloud Storage

Cloud SQL

Cloud Datastore

App Services

BigQuery

Cloud Endpoints

Caching

Queues

Compute

Compute Engine

App Engine

Storing what you want, however you want

Page 28: Google Cloud - Scale With A Smile (Dec 2014)

• Versioning

• Static Sites

• Resumable Transfers

• Object Change Notifications

Cloud Datastore

Page 29: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Datastore• Auto-scale

• Schemaless Access

• SQL-like Capabilities

• Authentication That Just Works

• Fast and Easy Provisioning

• RESTful Endpoints

• ACID Transactions

• Local Development Tools

• Built-in Redundancy

Page 30: Google Cloud - Scale With A Smile (Dec 2014)

Cloud SQL

• Fully managed

• Ease of Use

• Highly Reliable

• Flexible Charging

• Security, Availability, Durability

• EU and US Data Centers

• Easy Migration & Data Portability

• Control

Page 31: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

Storage

Cloud Storage

Cloud SQL

Cloud Datastore

App Services

BigQuery

Cloud Endpoints

Caching

Queues

Compute

Compute Engine

App Engine

Building robust, intelligent systems

Page 32: Google Cloud - Scale With A Smile (Dec 2014)

BigQuery

• Fully Managed Big Data Analytics Service

• Fast

• Scalable

• Flexible and Familiar

• Security and Reliability

The basics and BigQuery with Apps Script

Page 33: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

DEMO: Insights On Github

Page 34: Google Cloud - Scale With A Smile (Dec 2014)

Who’s making amazing things withGoogle Cloud Platform?

Page 35: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

Snapchat

Delivering 350+ million snaps a day

Page 36: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

Serving 18TB a day with 80 million

users from Google Cloud Storage,

Cloud Datastore, and App Engine

SongPop

Page 37: Google Cloud - Scale With A Smile (Dec 2014)

Cloud Platform

Eurovison

● Handled 50,000 requests/second

with 90% served in <24ms

● With Scalr and Compute Engine

Page 38: Google Cloud - Scale With A Smile (Dec 2014)

Powering the futurewith unprecedented features

Page 40: Google Cloud - Scale With A Smile (Dec 2014)

cloud.google.com

Images by Connie Zhou