Transcript
Page 1: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Your Private

Cloud Checklist:

The 5 Steps to an Enterprise-

Grade, Elastic Cloud

Page 2: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Today’s Speakers

Brady Murray

Director of Alliances

Eucalyptus Systems

Rich Wolski

Chief Technology Officer

Eucalyptus Systems

Tony Flint

IT, QA & Ops Manager

Wetpaint

Page 3: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Five Steps to

Deploying a

Private Cloud

Rich Wolski

Chief Technology Officer

August 25, 2011

Page 4: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

What is a Cloud?

SLAs

Web Services

Virtualization

Page 5: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

eCommerce + Infrastructure

• Self-service and “zero touch.”

– Scalable automatic rental of resource intensive goods

• Transactional and asynchronous

– Interaction with the site is transactional

– Delivery is asynchronous

• Site integrity and site availability are critical

– Individual transactions can fail but the site cannot

• Customer requests must be isolated

– Service venue must manage competing needs

• Scale out for request volume, scale up for request weight

Page 6: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

The Elements of Cloud Style

• The terms SaaS, PaaS, and IaaS are often viewed as creating a pain in the…

• SaaS (Software as a Service)

– Applications exporting network-facing user interfaces

– User transfers data to the cloud

• PaaS (Platform as a Service)

– Program or scripting runtime exports network-facing interfaces

– Internal platform services available

– User transfers program code and data to the cloud

• IaaS (Infrastructure as a Service)

– Resource provisioning services export network-facing interfaces

– Internal platform services available

– User transfers code, data, and environment to the cloud

Page 7: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

What’s in a Name?

• Elastic Utility Computing Architecture Linking Your Programs To Useful Systems

• Open source web services implementation of cloud computing IaaS

– Linux image hosting ala Amazon

• How do we know if it is a cloud?

– Try and emulate an existing cloud: Amazon AWS

• Functions as a software overlay

– Existing installation should not be violated (too much)

• Focus on installation and maintenance

– “System Administrators are people too.”

Page 8: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Private Clouds

• Separate the application software lifecycle from the infrastructure software lifecycle

– Application “stacks” can include operating environment

– Legacy applications can be transitioned gradually

• Separate application software from infrastructure configuration

– Clouds support a unified configuration model

– IT can reconfigure in response to technological innovation without breaking application execution

• Customized policy implementation

– Private clouds must respect local policy definitions

– One size does not need to fit all

Page 9: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Barriers Today

• Enterprise IT process change

– Infrastructure administration and management roles change due to the separation of concerns

– “Application infrastructure” versus “cloud infrastructure”

• Governance

– New IT roles require new policies

– Often polices must be cross-cutting with respect to existing org. chart

• Costing

– Private vs. Public vs. Hybrid

Page 10: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Preparing for Your Trip

• Start small and build incrementally

– Leverage existing infrastructure

– Target a specific use-case or application class

• Develop expertise in-house

– Local ground truth will improve the signal-to-noise ratio

• Be prepared to work “inside” the cloud and “outside” the cloud at the same time

– Private hybrid cloud = cloud + traditional IT in same data center

• Remember Wolski’s Law for APIs: Simple Scales

– Focus on simple APIs with clear success/fail semantics

Page 11: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Step 1 – Virtualization Mix

• Choose a Virtualization Mix

– Hypervisors differ in terms of

• Performance

• Cost

• Reliability

• Availability (distro support)

• Support

• Private Clouds use virtualization to implement isolation

– Consolidation density is not the primary concern

• A good private cloud solution will be able to use multiple hypervisors simultaneously

Page 12: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Step 2 – Understand Workload

• Private clouds can be configured in a multitude of ways

– Different from public clouds

• The best configuration or configurations depend on workload

– What application population will use the cloud?

– What resource requirements do these applications have?

• Private cloud abstractions can be customized to support application workload

Page 13: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Step 3 – VM Development

• Design a VM Development consultancy

– IT must consult (at least initially) with apps. groups on VM designs

• The cloud will protect the infrastructure from bad VMs

– Users have full control over the VMs they use

• User customization of VMs is a driver for private clouds

– VM quality must be ensured to protect cost savings

Page 14: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Step 4 – Accounting and

Recharge

• Develop accounting and recharge policies that

– Take into account self-service

– Are based on cloud abstractions rather than physical resources

• Self-service implies quotas

– What is the quota policy?

– What happens when it “fails?”

• Charge for minimum QoS and not physical occupancy

– Incentivize lightweight usage

Page 15: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Step 5 – Architect a Private

Cloud Deployment

• Infrastructure choices

– Use the existing datacenter resources

– Deploy infrastructure for cloud

• Extant datacenter configuration must be adopted by the cloud

– Useful for incremental deployment of applications

• Dedicated infrastructure should be deployed for QoS capacity

– Consider Price, QoS, and management complexity in the architecture

• Private cloud must support both options

Page 16: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

New in Eucalyptus 3

•High Availability IaaS

•Resource Access Control

AWS IAM

•Storage Enhancements

Boot Images from EBS

SAN Devices

•Platform Enhancements

Windows Images

RHEL 6, KVM

VMware

Company Confidential

Page 17: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Eucalyptus in the Wild

• Tony Flint, IT, QA & Operations Manager at

Page 18: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

IntroductionHistoryPresent DayLessons LearnedTools

Wetpaint and Eucalyptus

Page 19: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Introduction – About Tony

• Operations/IT/QA Manager

• 11 Years QA/Automation

Architecture experience

• Primarily worked in Operations since

2010

19

Page 20: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Introduction – About Wetpaint

• Online publishing company located in Seattle, WA, USA

• Founded in 2005, initially a Wiki platform company

• ~50 employees in Seattle, NYC and LA

• ~50mm monthly page views

• Awesome

20

Page 21: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

History

21

Old infrastructure model

• Lots of bare metal servers

• Power hungry

• Lots of maintenance/hardware failures

• New server = $$$ and a few hours in the data center

• Configuration management and deployments handled with Capistrano

Page 22: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Present Day

22

Page 23: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Persistent Storage – Our Approach

23

Page 24: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Present Day

24

New infrastructure model Benefits

• Much fewer, larger servers

• More energy efficient per server

• Less maintenance/hardware issues

• New server = one command

• Configuration management and deployments still handled with Capistrano (Capistrano is awesome)

Page 25: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Lessons Learned

25

Gotchas

• Getting others to think about ‘services’ rather than ‘servers’

• Think about differing hardware needs for each machine type in virtualization stack (cores, memory, IOPS)

• Come up with a plan for persistent storage (shared and per-instance)

• Use/implement a configuration management and deployment automation system

• Get good at creating new VM images

• Use the forums and IRC channel

• Consider Eucalyptus Enterprise

Page 26: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

Tools

26

Favorite Tools/Resources

• Ruby Version Manager (rvm.beginrescueend.com)

• Capistrano Deployment (capify.org)

• Varnish Cache (www.varnish-cache.org)

• Terminal multiplexer programs (byobu/screen/tmux)

• Configuration Management (CFEngine, Chef, Puppet)

• HAProxy (haproxy.1wt.eu/)

• MySQL MMM (mysql-mmm.org/)

• Graziano Obertelli, Tim Gerla and all the Eucalyptus folks

• Link to Eucalyptus posts: http://nefario.us/?tag=eucalyptus

Page 27: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Questions?

Page 29: Your Private Cloud Checklist: The 5 Steps to an Enterprise Grade, Elastic Cloud

© 2011 Eucalyptus Systems, Inc.

Thank

You!


Top Related