© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1

Mark T. Voelker, Technical Leader @ Cisco

OpenStack ATC/StackForge Puppet Core/Foundation Member #54

All Things Open 2014

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

@marktvoelker

• Tech Lead at Cisco, StackForge Puppet core developer, OS Foundation Member #54

• Fact: can be bribed with doughnuts

• Currently works in Cisco’s Cloud & Virtualization Group

• In copious (hah!) spare time: OpenStack solutions, Big Data, Massively Scalable Data Centers, Devops, making sawdust with extreme prejudice

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

• Tech lead, manager, software developer, architect

• Started in OpenStack in 2011 at the Diablo Design Summit

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

The great thing about my job is that I get to have fun exploring a lot of new things…

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

….and I get to help build a LOT of clouds.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

Today’s workshop won’t be overly formal….

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

…because I tend to get excited by this stuff.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

Fortunately I’m surrounded by really smart people on this project.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

“OpenStack is a global collaboration of developers and cloud computing technologists producing the ubiquitous open source cloud computing platform for public and private clouds. The project aims to deliver solutions for all types of clouds by being simple to implement, massively scalable, and feature rich. The technology consists of a series of interrelated projects delivering various components for a cloud infrastructure solution.”

-- openstack.org

Basically, it’s software to run cloud

services—including compute, network,

storage, and security—and the

community behind that software.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

06 07 08 09 10 11 12 13

Datacenter Spending (%) Over Time

Server Spending Standalone Servers - Mgnt & Admin

Virtual Servers - Mgnt & Admin Power & Cooling Expense

Source: IDC, 2011 “New Economic Model for the Datacenter”

• Operating expenses

represent over 80%

of data center spending

• OpEx increase driven by

server virtualization

• New models are needed

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

• Founded in July 2010 by Rackspace Hosting, NASA, and partners.• NASA contributed the compute controller (Nova) that it had built to control the NASA Nebula cloud (think: Amazon EC2).

• Rackspace contributed the object storage controller (Swift) that it built to run it’s CloudFiles service offering (think: Amazon S3).

• 10th release (Juno) released Oct. 16

• OpenStack (now) has a 6-month time-based release cycle

• Over 429 companies have now joined the community

• OS/Hypervisor makers: VMWare, Red Hat, Canonical, SuSE

• Public cloud/service providers: Rackspace, NTT, DreamHost, Comcast, AT&T

• Cloud service/tools/SaaS/value-add vendors: Puppet Labs, RightScale, OpsCode, ServiceMesh, New Relic, Scalr

• Equipment Vendors: Cisco, IBM, HP, Intel, NetApp, EMC, Brocade, Dell, Oracle

• OpenStack Software & Services: Piston, Mirantis, CloudScaling, Aptira, Bluebox

• App/Content Providers: Yahoo, eBay, GoDaddy, iWeb

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

• The OpenStack Foundation

• Membership is free for individuals

• Platinum, Gold, and Corporate memberships paid for by member companies

• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)

• Technical Committee leads software direction & development

• Elected by active technical contributors (ATC’s) to the OpenStack project

• Some seats were formerly automatically given to PTL’s…now all directly elected

• Program Technical Leads

• Elected to lead individual projects (e.g. Nova, Neutron, etc) by active technical contributors to those projects

• User Committee

• Represents users with the Technical Committee & Board of Directors

• More details here.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

• The OpenStack Foundation

• Membership is free for individuals

• Platinum, Gold, and Corporate memberships paid for by member companies

• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)

• Technical Committee leads software direction & development

• All members elected by active technical contributors

• User Committee represents users with the Technical Committee & Board of Directors

• More details here.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14

• Platinum Members: AT&T, Canonical, HP, IBM, Nebula, Rackspace, Red Hat, SuSE

• Gold Members: Aptira, Cloud Computing Association of Taiwan, Cisco, CloudScaling, Dell, Dreamhost, Ericsson, Hitachi, Huawei, Intel, Juniper, Mirantis, NEC, NetApp, Piston, VMWare, Yahoo

• Corporate Members: presently about 89 companies

• Supporting Organizations: presently around 316 companies

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15

• Over 16,900 members of the OpenStack Foundation spanning 145 countries on almost every continent

• Just about every major IT player, old and new…including some that seem to surprise some people

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

(Ok, that’s probably not *completely* true….)

…but a rising tide that lifts all boats is a mighty hard proposition to

resist for most companies.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17

IDG Connect Survey:

http://www.redhat.com/infographics/openstack-platform-for-private-cloud/

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20

• IRC Channels and Mailing Lists

• User/Meetup Groups

• Social NetworkingTwitter

LinkedIn

Facebook

Ohloh

• Code in cgit, mirrored on GitHub, Bugs/Milestones in Launchpad• For now…may move to StoryBoard in future

• Over 20 million lines of code by over 1,419 contributors

• Two Annual Design Summit/Conferences (coinciding roughly w/releases)

• Want to contribute? Start here.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22

OpenStack User Survey May 2014

http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23

Source: http://www.openstack.org/enterprise/auto/

Top 10 Automaker Turning Customer Insights into

Action with OpenStack at 1/10th the Cost of Legacy

Solution

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24

“The days of OpenStack being just about Cloud are over. OpenStack has become a platform for all manor of changes that are shaking up the tech industry.”

--Some guy on his soapbox in Raleigh today

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25

(that’s AT&T AVP Toby Ford telling 4500 people why he thinks OpenStack is the platform for NFV a few months ago in Atlanta)

(and that’s a Red Hat senior principal engineer and the Chief Scientist at Brocade

immediately reacting to it.)

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26

“OpenStack as an NFV Platform”

http://bit.ly/ZOnLyQ

Panel with guests from AT&T, Cisco, Red Hat, Yahoo!

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27

Horizon

NovaNeutron

Swift (Object Storage)

Cinder (Block storage)

Glance

(VM Image Service)

Keystone

(Identity Service)

AWS Management Console

EC2VPC

S3

EBS

Ceilometer

(Telemetry Service)

Trove

(Database Service) Heat

(Orchestration Service)

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28

• A “cloud computing fabric controller”.

• Basically, it’s what takes care of launching VM instances (think Amazon EC2).

• Abstracts hypervisors and hardware pools.

• Most operations can be invoked with a REST API call, a CLI client, or clicking in Horizon (the OpenStack GUI).

• A few features:

• Multiple hypervisors

• Multiple network models

• Distributed and asynchronous architecture

• Security groups

• Resource isolation for large deployments via cell architecture

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29

• Houses images that can be launched as instances

• Abstracts various image containers and backends.

• Multiple storage backends

• File, Swift, Ceph, etc

• Multiple container formats

• Bare, OVF, AKI, ARI, AMI

• Multiple disk formats

• Qcow2, raw, VHD, AKI/ARI/AMI, ISO, VDI, VMDK

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30

• Provides a central service for authentication and authorization as well as service catalog (e.g. where API endpoints are).

• Provides management of auth tokens passed in API calls as various components interoperate.

• Provides an abstraction layer above various auth backends such as LDAP or Active Directory.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31

• Provides persistent block storage CRUD and attachment/detachment from instances and snapshotting.

• Similar in some respects to Amazon EBS.

• Abstracts several underlying block storage components.

• Coraid, EMC, NetApp, IBM, LVM, Nexenta, NFS, Ceph RBD, SolidFire

• Originally part of OpenStack Nova, but split out into it’s own service in the Folsom release.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32

• Provides highly available, distributed, eventually consistent object storage.

• Can be run completely independently of OpenStack Compute.

• Often run on bare metal.

• Similar in many respects to Hadoop HDFS and Amazon S3.

• Replicates objects over multiple machines (usually 3).

• Works best when hypervisor doesn’t bottleneck disk I/O.

• Full API access/manipulation of objects

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33

• Provides “networking as a service” for OpenStack

• Designed to be capable of running independently of OpenStack

• oVirt has done work to use Neutron for a connectivity service

• Cloudstack has explored the possibility of using Neutron as well

• Is still evolving rapidly

• First (incubated) release: Diablo

• First (core) release: Essex

• First release with L3 functionality: Folsom

• First release with LBaaS functionality: Grizzly

• Now has LBaaS, VPNaaS, FWaaS services, NFV subteams, a Group Based Policy blueprint, an IPv6 subteam, and work commencing on Virtual Distributed Routers

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34

• Provides usage and performance data for OpenStack

• Initially designed with an eye toward billing, now provides broader insight

• oVirt has done work to use Quantum for a connectivity service

• Cloudstack has been exploring the possibility of using Quantum as well

• Is relatively young

• Still has some blind spots

• Extensible…relatively easy to add new meters in most cases

• Handles a *lot* of data

• Design goal: be able to share collected data with a variety of data consumers

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35

• Orchestrates ability to launch multiple composite clouds apps based on templates that can be treated like code.

• Templates have native format, but can use AWS CloudFormationformat too

• Frequently used for autoscaling services

• Primarily manages infrastructure, but integrates with tools like Puppet and Chef

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36

• Provides database services on demand with an elastic, API-driven interface in a multitenant environment

• Developers don’t have to care what the backend is or where it is

• Developers don’t have to go through tedious setup process

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37

• Hadoop (or Spark) as-a-service (think similar to Amazon Elastic MapReduce)

• Simple, on demand provisioning of Hadoop clusters

• Different distributions of Hadoop available on the backend

• Can be managed via API or Horizon

• Offers integration with management tools like Ambari or ClouderaManagement Console

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38

Library Projects

Supporting Projects

Documentation

Oslo (common code libraries)

Client libraries

Incubated Projects

(may become core

components in the future)

Designate (DNS service)

Zaqar (queuing service)

Gating Projects

CI & Infrastructure

DevStack (deployment script)

Tempest (integration test)

Barbican (key management)

Manila (shared FS as a

service)

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39

• It’s a bash script.

• It installs OpenStack from the latest version in trunk on a single (or multiple) node.

• Used by developers to quickly get an environment in which they can work on features or bugfixes.

• Not a good way to deploy in production, but useful for getting your feet wet.

• Arvind Somya and Kyle Mestery did a demo and presentation of DevStack recently for the Triangle OpenStack Meetup a while back. Say, who’s Arvind? Well…

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40

• A hypervisor• Except when you don’t.

• KVM and Xen are the best supported today. Hyper-V, QEMU, LXC, VMware also work. See hypervisor comparison.

• A database• Most use MySQL, but PostgreSQL and others also work since most code uses the

SQLAlchemy ORM layer.

• Used for persisting operational data.

• A message queue• Most use RabbitMQ, some use Qpid and ZeroMQ works in some components as well.

• Used for fast interprocess communications (ex: nova scheduler talking to nova network controller)

• Hardware• Pools of servers, memory, cpu, disk

• Python Stuff• Most components run under Python 2.6+

• A few major libraries: Django, Eventlet, SQL Alchemy, many more

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41

• Putting your best foot forward means putting your code where your mouth is.

Ideas are more readily accepted when there’s effort to back them up.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42

• Don’t be intimidated.

• HolycrapthingsmovereallyreallyfastinOpenStack

• Jump in feet first: be agile and flexible.

• This is going to feel a little different for some of you.

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43

Questions?@marktvoelker

http://openstack.org/

http://cisco.com/go/openstack/

(yes, we’re hiring!)