openstack: everything you need to know to get started
TRANSCRIPT
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1
Mark T. Voelker, Technical Leader @ Cisco
OpenStack ATC/StackForge Puppet Core/Foundation Member #54
All Things Open 2014
OpenStack: Everything You Need To Know to Get Started
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
Mark T. Voelker (@marktvoelker)• Tech Lead at Cisco, StackForge Puppet core developer, OS Foundation
Member #54
• Fact: can be bribed with doughnuts
• Currently works in Cisco’s Cloud & Virtualization Group
• In copious (hah!) spare time: OpenStack solutions, Big Data, Massively Scalable Data Centers, Devops, making sawdust with extreme prejudice
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
A little about me….• Tech lead, manager, software developer, architect
• Started in OpenStack in 2011 at the Diablo Design Summit
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
A little about me…The great thing about my job is that I get to have fun exploring a lot of new things…
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
A little about me….….and I get to help build a LOT of clouds.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
A little about me….Today’s workshop won’t be overly formal….
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
A little about me….…because I tend to get excited by this stuff.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
There are a few other people working on OpenStack….Fortunately I’m surrounded by really smart people on this project.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
What is OpenStack?“OpenStack is a global collaboration of developers and cloud computing technologists producing the ubiquitous open source cloud computing platform for public and private clouds. The project aims to deliver solutions for all types of clouds by being simple to implement, massively scalable, and feature rich. The technology consists of a series of interrelated projects delivering various components for a cloud infrastructure solution.”
-- openstack.org
Basically, it’s software to run cloud services—including compute, network, storage, and security—and thecommunity behind that software.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
06 07 08 09 10 11 12 130%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Datacenter Spending (%) Over Time
Server Spending Standalone Servers - Mgnt & AdminVirtual Servers - Mgnt & Admin Power & Cooling Expense
Source: IDC, 2011 “New Economic Model for the Datacenter”
• Operating expenses represent over 80% of data center spending
• OpEx increase driven by server virtualization
• New models are needed
Management (OpEx) Expenses Growing
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
Community History• Founded in July 2010 by Rackspace Hosting, NASA, and partners.
• NASA contributed the compute controller (Nova) that it had built to control the NASA Nebula cloud (think: Amazon EC2).
• Rackspace contributed the object storage controller (Swift) that it built to run it’s CloudFiles service offering (think: Amazon S3).
• 10th release (Juno) released Oct. 16• OpenStack (now) has a 6-month time-based release cycle
• Over 429 companies have now joined the community• OS/Hypervisor makers: VMWare, Red Hat, Canonical, SuSE
• Public cloud/service providers: Rackspace, NTT, DreamHost, Comcast, AT&T
• Cloud service/tools/SaaS/value-add vendors: Puppet Labs, RightScale, OpsCode, ServiceMesh, New Relic, Scalr
• Equipment Vendors: Cisco, IBM, HP, Intel, NetApp, EMC, Brocade, Dell, Oracle
• OpenStack Software & Services: Piston, Mirantis, CloudScaling, Aptira, Bluebox
• App/Content Providers: Yahoo, eBay, GoDaddy, iWeb
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
Governance / Structure• The OpenStack Foundation
• Membership is free for individuals
• Platinum, Gold, and Corporate memberships paid for by member companies
• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)
• Technical Committee leads software direction & development• Elected by active technical contributors (ATC’s) to the OpenStack project
• Some seats were formerly automatically given to PTL’s…now all directly elected
• Program Technical Leads• Elected to lead individual projects (e.g. Nova, Neutron, etc) by active technical contributors to those projects
• User Committee • Represents users with the Technical Committee & Board of Directors
• More details here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
Governance / Structure• The OpenStack Foundation
• Membership is free for individuals
• Platinum, Gold, and Corporate memberships paid for by member companies
• Board of Directors comprised of Platinum, Gold, & elected members (basically a marketing/IP group—does not directly influence the software)
• Technical Committee leads software direction & development• All members elected by active technical contributors
• User Committee represents users with the Technical Committee & Board of Directors
• More details here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
Community Corporate Makeup• Platinum Members: AT&T, Canonical, HP, IBM, Nebula, Rackspace, Red
Hat, SuSE
• Gold Members: Aptira, Cloud Computing Association of Taiwan, Cisco, CloudScaling, Dell, Dreamhost, Ericsson, Hitachi, Huawei, Intel, Juniper, Mirantis, NEC, NetApp, Piston, VMWare, Yahoo
• Corporate Members: presently about 89 companies
• Supporting Organizations: presently around 316 companies
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
Who’s In?• Over 16,900 members of the OpenStack Foundation spanning
145 countries on almost every continent
• Just about every major IT player, old and new…including some that seem to surprise some people
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16
Who’s Not In?
(Ok, that’s probably not *completely* true….)
…but a rising tide that lifts all boats is a mighty hard proposition to resist for most companies.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
The Time For OpenStack Has Come
IDG Connect Survey: http://www.redhat.com/infographics/openstack-platform-for-private-cloud/
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18
Forrester Research in Fall 2012….
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
Forrester Research in Spring 2014
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
Community Participation• IRC Channels and Mailing Lists
• User/Meetup Groups
• Social NetworkingTwitter
Ohloh
• Code in cgit, mirrored on GitHub, Bugs/Milestones in Launchpad• For now…may move to StoryBoard in future
• Over 20 million lines of code by over 1,419 contributors
• Two Annual Design Summit/Conferences (coinciding roughly w/releases)
• Want to contribute? Start here.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
LocalMeetups
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22
OpenStack User Survey May 2014http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey
But why OpenStack now?
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
Cost savings?
Source: http://www.openstack.org/enterprise/auto/
Top 10 Automaker Turning Customer Insights into Action with OpenStack at 1/10th the Cost of Legacy Solution
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
And by the way….
“The days of OpenStack being just about Cloud are over. OpenStack has become a platform for all manor of changes that are shaking up the tech industry.”
--Some guy on his soapbox in Raleigh today
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
…and, say, this guy.
(that’s AT&T AVP Toby Ford telling 4500 people why he thinks OpenStack is the platform for NFV a few months ago in Atlanta)
(and that’s a Red Hat senior principal engineer and the Chief Scientist at Brocade immediately reacting to it.)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
Shameless Plug!
“OpenStack as an NFV Platform”http://bit.ly/ZOnLyQ
Panel with guests from AT&T, Cisco, Red Hat, Yahoo!
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27
Horizon
NovaNeutron
Swift (Object Storage)
Cinder (Block storage)
Glance(VM Image Service)
Keystone(Identity Service)
OpenStack: The Software
AWS Management Console
EC2VPC
S3
EBS
Ceilometer(Telemetry Service)
Trove(Database Service) Heat
(Orchestration Service)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28
OpenStack Compute (Nova)• A “cloud computing fabric controller”.
• Basically, it’s what takes care of launching VM instances (think Amazon EC2).
• Abstracts hypervisors and hardware pools.
• Most operations can be invoked with a REST API call, a CLI client, or clicking in Horizon (the OpenStack GUI).
• A few features:• Multiple hypervisors
• Multiple network models
• Distributed and asynchronous architecture
• Security groups
• Resource isolation for large deployments via cell architecture
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29
OpenStack Image Service (Glance)• Houses images that can be launched as instances
• Abstracts various image containers and backends.
• Multiple storage backends• File, Swift, Ceph, etc
• Multiple container formats• Bare, OVF, AKI, ARI, AMI
• Multiple disk formats• Qcow2, raw, VHD, AKI/ARI/AMI, ISO, VDI, VMDK
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30
OpenStack Identity (Keystone)• Provides a central service for authentication and authorization as
well as service catalog (e.g. where API endpoints are).
• Provides management of auth tokens passed in API calls as various components interoperate.
• Provides an abstraction layer above various auth backends such as LDAP or Active Directory.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31
OpenStack Block Storage (Cinder)• Provides persistent block storage CRUD and
attachment/detachment from instances and snapshotting.
• Similar in some respects to Amazon EBS.
• Abstracts several underlying block storage components.• Coraid, EMC, NetApp, IBM, LVM, Nexenta, NFS, Ceph RBD, SolidFire
• Originally part of OpenStack Nova, but split out into it’s own service in the Folsom release.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32
OpenStack Object Storage (Swift)• Provides highly available, distributed, eventually consistent object
storage.
• Can be run completely independently of OpenStack Compute.
• Often run on bare metal.
• Similar in many respects to Hadoop HDFS and Amazon S3.• Replicates objects over multiple machines (usually 3).
• Works best when hypervisor doesn’t bottleneck disk I/O.
• Full API access/manipulation of objects
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33
OpenStack Networking (Neutron)• Provides “networking as a service” for OpenStack
• Designed to be capable of running independently of OpenStack• oVirt has done work to use Neutron for a connectivity service
• Cloudstack has explored the possibility of using Neutron as well
• Is still evolving rapidly• First (incubated) release: Diablo
• First (core) release: Essex
• First release with L3 functionality: Folsom
• First release with LBaaS functionality: Grizzly
• Now has LBaaS, VPNaaS, FWaaS services, NFV subteams, a Group Based Policy blueprint, an IPv6 subteam, and work commencing on Virtual Distributed Routers
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34
OpenStack Telemetry (Ceilometer)• Provides usage and performance data for OpenStack
• Initially designed with an eye toward billing, now provides broader insight
• oVirt has done work to use Quantum for a connectivity service
• Cloudstack has been exploring the possibility of using Quantum as well
• Is relatively young• Still has some blind spots
• Extensible…relatively easy to add new meters in most cases
• Handles a *lot* of data
• Design goal: be able to share collected data with a variety of data consumers
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35
OpenStack Orchestration (Heat)• Orchestrates ability to launch multiple composite clouds apps
based on templates that can be treated like code.
• Templates have native format, but can use AWS CloudFormation format too
• Frequently used for autoscaling services
• Primarily manages infrastructure, but integrates with tools like Puppet and Chef
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36
OpenStack Database -aaS (Trove)• Provides database services on demand with an elastic, API-
driven interface in a multitenant environment
• Developers don’t have to care what the backend is or where it is
• Developers don’t have to go through tedious setup process
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37
OpenStack Data Processing (Sahara)• Hadoop (or Spark) as-a-service (think similar to Amazon Elastic
MapReduce)
• Simple, on demand provisioning of Hadoop clusters
• Different distributions of Hadoop available on the backend
• Can be managed via API or Horizon
• Offers integration with management tools like Ambari or Cloudera Management Console
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38
Library Projects
But Wait, There’s More!Supporting Projects
Documentation
Oslo (common code libraries)
Client libraries
Incubated Projects(may become core components in the future)
Sahara (Hadoop service)
Marconi (queuing service)
Gating Projects
CI & Infrastructure
DevStack (deployment script)
Tempest (integration test)
Barbican (key management)
Ironic (bare metal as a service)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39
What is ? • It’s a bash script.
• It installs OpenStack from the latest version in trunk on a single (or multiple) node.
• Used by developers to quickly get an environment in which they can work on features or bugfixes.
• Not a good way to deploy in production, but useful for getting your feet wet.
• Arvind Somya and Kyle Mestery did a demo and presentation of DevStack recently for the Triangle OpenStack Meetup a while back. Say, who’s Arvind? Well…
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40
Ok, but what do I need for OpenStack itself?
• A hypervisor• Except when you don’t.
• KVM and Xen are the best supported today. Hyper-V, QEMU, LXC, VMware also work. See hypervisor comparison.
• A database• Most use MySQL, but PostgreSQL and others also work since most code uses the
SQLAlchemy ORM layer.
• Used for persisting operational data.
• A message queue• Most use RabbitMQ, some use Qpid and ZeroMQ works in some components as well.
• Used for fast interprocess communications (ex: nova scheduler talking to nova network controller)
• Hardware• Pools of servers, memory, cpu, disk
• Python Stuff• Most components run under Python 2.6+
• A few major libraries: Django, Eventlet, SQL Alchemy, many more
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41
Some Things We’ve Learned• Putting your best foot forward means putting your code
where your mouth is.Ideas are more readily accepted when there’s effort to back them up.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42
New to the community?• Don’t be intimidated.
• HolycrapthingsmovereallyreallyfastinOpenStack
• Jump in feet first: be agile and flexible.
• This is going to feel a little different for some of you.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43
Questions?@marktvoelker
http://openstack.org/
http://cisco.com/go/openstack/
(yes, we’re hiring!)
