what's new in open stack juno (pnw os meetup)

Post on 02-Jul-2015

515 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

From the November Pacific North West OpenStack meetup: this talk will provide an overview of the latest OpenStack release, Juno. New project additions, newly incubated projects and changes in the community will be discussed. We'll also talk about some of the changes we can expect to see in the Kilo development cycle currently underway.

TRANSCRIPT

Copyright © 2014 Mirantis, Inc. All rights reserved

www.mirantis.com

A Technical Overview

What's New in OpenStack Juno

November 19, 2014

Copyright © 2014 Mirantis, Inc. All rights reserved

Introductions

Christopher Aedo (here in person) — Product Architect at Mirantis

Christopher is an IT veteran for consulting, design and technology companies. He is also an outspoken public advocate for OpenStack, cloud computing, software defined networking and software defined storage. He often speaks at OpenStack and Open Source related conferences around the world.

Nick Chase (here in spirit) — Technical Product Marketing at Mirantis

Nick has 20+ years' experience as a developer and author and is an IBM developerWorks Certified Master Author. He also founded NoTooMi.com and has done Web application development for companies such as Alcatel-Lucent, Sun Microsystems, Oracle, and the Tampa Bay Buccaneers. He's also the editor of OpenStack:Now.

Copyright © 2014 Mirantis, Inc. All rights reserved

Agenda

● OpenStack Juno Overview● Project Additions● Incubated Projects● Community Changes● Coming in Kilo● Kilo Design Summit in Paris● Q&A

Copyright © 2014 Mirantis, Inc. All rights reserved

Fixes over features

OpenStack Juno Overview

Copyright © 2014 Mirantis, Inc. All rights reserved

Direction

● Enterprise adoption on the rise● Best Buy● Bloomberg● eBay● Comcast

● Conscious attempt to provide a better experience for operators

● End-user working group● Stability over new features

Copyright © 2014 Mirantis, Inc. All rights reserved

Deployment improvements

● One size does not fit all

Copyright © 2014 Mirantis, Inc. All rights reserved

The statistics

Copyright © 2014 Mirantis, Inc. All rights reserved

To implement services and associated libraries to provide massively scalable, on demand, self service access to compute

resources, including bare metal, virtual machines, and containers.

OpenStack Compute (Nova)

Copyright © 2014 Mirantis, Inc. All rights reserved

NFV

● New working group● Multiple interfaces per network● Improved performance

● PCI-SR-IOV● Large page allocation● Peg vCPUs to pCPUs● Control vCPU configurations

Copyright © 2014 Mirantis, Inc. All rights reserved

Rescue Mode

● Ability to specify a rescue image on launch POST: /v2/d1b123/servers/7d14f8123/action \

-d '{"rescue": {"rescue_image_ref": "a88ddc123"}}'

● Local disks re-attached during rescue

Copyright © 2014 Mirantis, Inc. All rights reserved

Docker

● Driver in stackforge● Pause/Unpause

Copyright © 2014 Mirantis, Inc. All rights reserved

Networking

● Unfrozen in Juno to align with Neutron● Ability to set "hooks" to be executed for specific

networking events● Per-network settings● SR-IOV neutron ports

Copyright © 2014 Mirantis, Inc. All rights reserved

Upgrades

● Rolling upgrades of Nova possible from Havana to Icehouse

● Ongoing process● Continuing to move to Objects● Version everything

Copyright © 2014 Mirantis, Inc. All rights reserved

Scheduler

● Being broken out into the Gantt project so it can be used by other projects

● Resource tracking, so when an instance is rescued the scheduler knows what needs to go where

● Host aggregates

Copyright © 2014 Mirantis, Inc. All rights reserved

Hypervisor improvements

● libvirt● Performance, logging improvements● Snapshots of network backed disks● Enable qemu memory balloon statistics for ceilometer reporting● Unused disk blocks given back to the underlying storage system● Records meta-data in libvirt domain XML● Namespaces for LXC containers● Copy-on-write cloning for RBD-backed disks● Controlled shutdown of guest OS during VM power off● Intelligent NUMA node placement for guests

Copyright © 2014 Mirantis, Inc. All rights reserved

Hypervisor improvements

● Hyper-V● Soft reboot, better logging, differencing vhdx images

● Ironic● Add a virt driver for Ironic

● VMware● Changed to use the Oslo vmware helper library

Copyright © 2014 Mirantis, Inc. All rights reserved

To implement services and associated libraries to provide on-demand, scalable, and technology-agnostic network abstraction.

OpenStack Network Service (Neutron)

Copyright © 2014 Mirantis, Inc. All rights reserved

Feature parity

● Feature parity with nova-network in progress● Initial migration path (prerequisite for nova-network

deprecation)

Copyright © 2014 Mirantis, Inc. All rights reserved

L3 Enhancements

● Multiple L3 agents● HA through plugins

● In Juno, through keepalived

● Each router created is assigned to 2 or more agents

Copyright © 2014 Mirantis, Inc. All rights reserved

Distributed Virtual Router (DVR)

● Uses L3 HA● Removes bottleneck in east-

west traffic● shares OVS route information

across virtual routers

● one-hop traffic for VMs on different hypervisors

● Requires OVS on ML2

Copyright © 2014 Mirantis, Inc. All rights reserved

IPv6

● Next generation of IP routing● 2001:0db8:85a3:0042:1000:8a2e:0370:7334

rather than 10.28.255.168● 3.4×1038 addresses rather than 4.3 billion● Address assignment

● SLAAC● Stateful DHCP● Stateless DHCP

● Router advertisement through RADVD

Copyright © 2014 Mirantis, Inc. All rights reserved

New Plugins

● A10 Networks LBaaS driver for the LBaaS V1 API● Arista L3 routing plugin● Big Switch L3 routing plugin● Brocade L3 routing plugin● Cisco APIC ML2 Driver (including a L3 routing plugin).● Cisco CSR L3 routing plugin● Freescale SDN ML2 Mechanism Driver● Nuage Networks ML2 Mechanism Driver● SR-IOV capable NIC ML2 Mechanism Driver

Copyright © 2014 Mirantis, Inc. All rights reserved

Deprecated Plugins

● Cisco Nexus Sub-Plugin (The Nexus 1000V Sub-Plugin is still retained and supported in Juno)

● Mellanox Plugin● Ryu Plugin● (Should still work as ML2 plugins though!)

Copyright © 2014 Mirantis, Inc. All rights reserved

Goodbye native OVS, LinuxBridge

● Deprecated in Icehouse● Removed in Juno● Replaced by ML2 MechanismDrivers

Copyright © 2014 Mirantis, Inc. All rights reserved

To implement services and libraries to provide on-demand, self-service access to Block Storage resources via abstraction and

automation on top of other block storage devices.

OpenStack Block Storage (Cinder)

Copyright © 2014 Mirantis, Inc. All rights reserved

Continuing development

● Nova is now using v2 API; v1 API deprecated● Third party CI● Contributor base is moving towards feature development

rather than just driver development

Copyright © 2014 Mirantis, Inc. All rights reserved

New Drivers

● EMC VNX FC direct driver● EMC XtremIO iSCSI driver● EMC XtremIO FC driver● Fusion-io Control Volume driver● ZFS Storage Appliance driver● ProphetStor driver● Volume driver for Pure Storage FlashArray storage system● XenAPI Storage Manager volume driver

Copyright © 2014 Mirantis, Inc. All rights reserved

OpenStack Object Storage (Swift)

Copyright © 2014 Mirantis, Inc. All rights reserved

Storage policies

● Allows different storage types per object● Replication settings per object● Available through the API

Copyright © 2014 Mirantis, Inc. All rights reserved

Other additions

● Project-to-project copy● Keystone v3 support

Copyright © 2014 Mirantis, Inc. All rights reserved

To provide a service where users can upload and discover data assets that are meant to be used with other services, like images

for Nova and templates for Heat.

OpenStack Image Service (Glance)

Copyright © 2014 Mirantis, Inc. All rights reserved

Beyond images

● Moving to artifact storage model● Addition of metadata

Copyright © 2014 Mirantis, Inc. All rights reserved

Usability

● Restrict downloads based on policy● Asynchronous processing to improve performance

Copyright © 2014 Mirantis, Inc. All rights reserved

To facilitate API client authentication, service discovery, distributed multi-tenant authorization, and auditing.

OpenStack Identity (Keystone)

Copyright © 2014 Mirantis, Inc. All rights reserved

Backend improvements

● Multiple Identity backends● For example, LDAP for existing users, Keystone's SQL back end

for OpenStack users● Set per resource ID● Map Keystone's "enabled" property to LDAP's "lock" property

● LDAPs now available

Copyright © 2014 Mirantis, Inc. All rights reserved

Keystone-to-Keystone Federation

● Two Keystone services in tandem● Identity Provider● Service Provider

● Can be used for bursting between clouds

● Single-sign on● Older federation endpoints to be

deprecated● This feature is experimental

Copyright © 2014 Mirantis, Inc. All rights reserved

Token changes

● UUID now the default for simplicity● PKIZ rather than PKI

● Smaller keys mean it's easier to use external data store through Apache httpd -- and generalize federation (not just SAML)

● Also possible for Kerberos and X.509

Copyright © 2014 Mirantis, Inc. All rights reserved

Behind the Scenes

● Service catalogs available via the v3 API● Addition of service names to the catalog

● Filter by service name

● Enable to user to retrieve only their credentials

Copyright © 2014 Mirantis, Inc. All rights reserved

To provide an extensible unified web based user interface for all integrated OpenStack services.

OpenStack Dashboard (Horizon)

Copyright © 2014 Mirantis, Inc. All rights reserved

General Improvements

● Many project-related additions● Look and feel, move to Bootstrap 3● Centralized color pallette● Tablesorter

Copyright © 2014 Mirantis, Inc. All rights reserved

JavaScript Library Unbundling

● Security issues● Maintenance issues

Copyright © 2014 Mirantis, Inc. All rights reserved

Added Sahara

Copyright © 2014 Mirantis, Inc. All rights reserved

Role Based Access Control

● Fine-grained control for access● Compute● Networking● Orchestration● Glance and Swift were added in Icehouse

Copyright © 2014 Mirantis, Inc. All rights reserved

Create a human and machine accessible service for managing

the entire lifecycle of infrastructure and applications within

OpenStack clouds.

OpenStack Orchestration (Heat)

Copyright © 2014 Mirantis, Inc. All rights reserved

Better scaling

● Multiple Heat servers● Multiple users can run stacks concurrently

Copyright © 2014 Mirantis, Inc. All rights reserved

Better failure handling

● Cancel update● Update failure recovery

Copyright © 2014 Mirantis, Inc. All rights reserved

Delegation

● Better delegation for non-admin users● Heat users created in separate project/namespace

Copyright © 2014 Mirantis, Inc. All rights reserved

New Resources

● Sahara● Glance Image

Copyright © 2014 Mirantis, Inc. All rights reserved

To reliably collect measurements of the utilization of the physical and virtual resources comprising deployed clouds, persist these data for subsequent retrieval and analysis, and

trigger actions when defined criteria are met.

OpenStack Telemetry (Ceilometer)

Copyright © 2014 Mirantis, Inc. All rights reserved

General changes

● Community changes● Re-architecting for performance

● Gnocchi

Copyright © 2014 Mirantis, Inc. All rights reserved

Monitoring Network Events

● Firewall as a Service● Load Balancer as a Service● VPN as a Service

Copyright © 2014 Mirantis, Inc. All rights reserved

To provide scalable and reliable Cloud Database as a Service functionality for both relational and non-relational database

engines, and to continue to improve its fully-featured and extensible open source framework.

OpenStack Database Service (Trove)

Copyright © 2014 Mirantis, Inc. All rights reserved

New Database Options

● SQL● Postgres

● NoSQL● MongoDB● Added database type● Added capabilities so Horizon can present appropriate options

Copyright © 2014 Mirantis, Inc. All rights reserved

Replication and clustering

● Replication● Set a master● Add a slave● Promote a slave● Detach a slave to be a new master

● Clustering● Create an instance individually or as part of a cluster

Copyright © 2014 Mirantis, Inc. All rights reserved

Convenience

● Ability to create databases in Horizon● Configuration groups● Incremental backup

Copyright © 2014 Mirantis, Inc. All rights reserved

Backend improvements

● Trove-conductor isolates the created databases from the trove database itself

● Better integration with Tempest API

Copyright © 2014 Mirantis, Inc. All rights reserved

To provide a scalable data processing stack and associated management interfaces.

OpenStack Data Processing (Sahara)

Copyright © 2014 Mirantis, Inc. All rights reserved

What is Sahara?

● Data processing● Originally to

easily deploy data processing frameworks such as Hadoop and Spark

Copyright © 2014 Mirantis, Inc. All rights reserved

Updates

● Update to Hadoop 2.4● Cloudera plugin has been added● Apache Spark plugin has been added● Addition of Spark as a job type

● Designed to run Java and Hive● Spark currently runs as Java, but may change later

Copyright © 2014 Mirantis, Inc. All rights reserved

Deployment improvements

● Now installs with Heat● Multi-region support -- not what you think● Integrated with Ceilometer● Anti-affinity through server groups● Security groups added by default

Copyright © 2014 Mirantis, Inc. All rights reserved

Provide documentation for core OpenStack projects to promote OpenStack. Develop and maintain tools and processes to ensure

quality, accurate documentation. Treat documentation like OpenStack code.

OpenStack Documentation

Copyright © 2014 Mirantis, Inc. All rights reserved

Guides

● High Availability Guide, Security Guide broken out into separate repositories

● New Architecture Guide produced via the book sprint process

Copyright © 2014 Mirantis, Inc. All rights reserved

Improving community participation

● Push for projects to self-document● Networking Guide swarm● Experiment with working on the wiki environment

Copyright © 2014 Mirantis, Inc. All rights reserved

Incubated Projects

Copyright © 2014 Mirantis, Inc. All rights reserved

Graduated

● Sahara (Juno)● Ironic (Kilo)

Copyright © 2014 Mirantis, Inc. All rights reserved

Added to incubation

● Zaqar (formerly Marconi)● Designate● Manila● Barbican

Copyright © 2014 Mirantis, Inc. All rights reserved

Community Changes

Copyright © 2014 Mirantis, Inc. All rights reserved

DefCore

● DefCore to define "OpenStack" -- for trademark purposes● RefStack to verify

● The Technical Committee still defines the "integrated" release● Should we consider changing the "incubation" model?● Layers versus big tent versus rings versus tags versus ...

Copyright © 2014 Mirantis, Inc. All rights reserved

New specifications process

Copyright © 2014 Mirantis, Inc. All rights reserved

DriverLog and Vendor CI

Copyright © 2014 Mirantis, Inc. All rights reserved

April 30, 2015

Coming in Kilo

Copyright © 2014 Mirantis, Inc. All rights reserved

Product changes

● Nova● The return of Docker to the Nova project

● Neutron● NFV functions● Stability improvements● Possible nova-network deprecation

● Swift● Erasure coding

Copyright © 2014 Mirantis, Inc. All rights reserved

Paris Summit

Copyright © 2014 Mirantis, Inc. All rights reserved

Paris Summit

● Nova-Network deprecation takes shape● Docker love continues to grow● Neutron keeps improving● No consensus on upgrading OpenStack

● Pumphouse has potential

● Big-name adoption growing● EVERYONE is hiring

Copyright © 2014 Mirantis, Inc. All rights reserved

Download the slides from: bit.ly/openstack-juno(and we’re hiring, ask me about working at Mirantis!)

caedo@mirantis.com - twitter: @docaedo

Thank you

top related